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ABSTRACT 

This book contains I* 7 papers prepared for a 
colloquium series on development and related research dealing ”ith 
conditions and Processes of learning, sublect matter content and 
sequence, instructional media, and instructional methods and teacher 
behaviors: 1) "Organized Retention and Cued Recall" by Fndel living; 
2) "Developmental Processes in Thought," Kenneth Lovell; 3) 

"Promoting Creative thinking in the Classroom," Martin Covington; 4) 
"Measuring Motivation in Culturally Disadvantaged School Children," 
Richard deCharms; c ) "Curriculum nosearch in Mathematics," E. G. 

Besle; 6) "curriculum Research in Science," Arthur H. Livermore; 7) 
"Curriculum Research and Development in English," Robert Poolev; 8) 
"Research in Peadinq," Wayne Otto; °) "Strategies for Concept 
Attainment in Mathematics," Myron Rosskopf; 10) "Instructional 
Television Around the World," Wilbur Schramm; 11) "Instructional 
Pesearch: Sore Aspects o* Its Status, Defects, and Needs," Arthur 
Lumsdaine; 12) "SOCRATES, A. Computer-Based Instructional System in 
Theory and Pesearch," Lawrence Stoluiov; 13) "An Analytical Approach 
to Research on Instructional Methods," Hathanial Gage: 14) 
"Interaction Analysis and Inservico Training," Ned Flanders; 1 e ) 
"Research and Development Strategies: "ho Current Sc®ne," Louis 
Bright; 16) "The Wisconsin Pesearch and Development Center for 
r oqnitive Learning," Herbert Klausmeier; 17) «»n Output-Oriented 
Model of Research and Development and Its Relationship to Educational 
Improvement," Her.drick Gideonse. (IS) 
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In THIS HOOK 20 eminent scholars, researchers, and research administrators 
present their latest thinking about the processes and conditions of human 
learning, the processes and programs of Instruction, and the application of 
research and development strategies to cdueational problems. 

As the editors point out m the Preface, the application of research and develop- 
ment strategies for the improvement of educational practices is a pioneering 
venture begun in 1964 under the provisions the Cooperative Research 
Program of the United States Office of Education and now continuing through 
Title IV of the Elementary and Secondary Education Act of 1965. 

Working from a proposed model outlined in Chapter 16, the editors have 
organised the book around the major components of an instructional system, 

Basic to the improvement of education is knowledge about the processes end 
conditions necessary for efficient baming, In Part I, four authors discuss 
retention and recall, thought processes, creative thinking, and motivation. 

A major component of an instructional system is subject matter content and 
sequence, In Part II, five authors provide scholarly Insights Into the structures of 
such disciplines as mathcmrtics, science, English, and reading. They state or 
Imply that the structure of the discipline itself, as formulated by one or more 
scholars, has provided much of the basis for recent curriculum development. 

Instiuctfonal materials and media can bo vonsldercd os the interface between 
the learner and the subject matter being learned. In Part III, the discussion 
focuses on instructional television, on some aspects of the status, defects, 
and needs of instructional research, and on computer-based instruction. 

Teaching methods, or the interactions which occur between a teacher and 
students, have been the subject of many research studies in the last decades. 

In Pan IV, two recent paradigms for research on teaching arc presented. 

One approach discusses what is commonly called micro-teaching and the other 
is Interaction analysis. 

Finally, fn Part V, three research administrators discuss the current application 
of research nnd development strategies for the impiovcment of educational 
practices. The present scene fn educational R&D Is one of rapid change 
brought about largely by the advent of Federal funding. The development of 
these changes with reference to Federal involvement is traced In one chapter. 

In another chapter the focus and programs of the Wisconsin Research and 
Development Center for Cognitive Learning are described. And in the final 
chapter an author presents an output-oriented model of RAD. 

Rrsecfch and Development Toward the Improvement of Education grows out 
of a colloquium series sponsored recently by the Wisconsin RAD Center. The 
book has been published by Dembar Educational Research Services, Inc., as, a 
contribution to the field, without financial support other than that 
engendered by sales. 
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PREFACE 



THE FIRST systematic attempt to apply research and development 
strategies to education occurred with the establishment of four research and 
development (R&D) centers in 1964 as part of the Cooperative Research Pro- 
gram of the United Slates Office of Education. The R & 0 Centers piogram attempted 
to combine the best featuros of the separate programs of the U.S.O.E.i basic 
and applied research, development, curriculum improvement, and demonstration. 
Thus, an R & D Center is organized to conduct basic research related to a sig- 
nificant problem area; to develop substantive and procedural products and con- 
duct related research; to demonstrate the results of the research and develop- 
ment activities in a few school settings; and to take initiative for the eventual 
widespread dissemination of the research results and tested products. An R&D 
Center, located on a university campus, draws its professorial staff from the be- 
havioral sciences, subject disciplines, communications, educational methodology, 
and other fields. It is a community of scholars, capable of dealing with a prob- 
lem area effectively. In an R&D Center, then, human and financial resources 
are concentrated on o parliculo. problem area over on extended period of time 
in order to secure a better understanding of that problem crea and to improve 
related educational practices. Since 1964 the number of R & D Centers hos in- 
creased from four to nine. 

Our major universities, including the nine where R&D Centers are 
located, have a large pool of able researchers and many other resources. How- 
ever, the development and applicolion of research and development strategies to 
education is a pioneer venture. Developing imaginative strategies for extending 
knowledge about cognitive learning and improving related educational practices 
It a contini'i.'g concern of the Wisconsin Research and Development Center for 
Cognitive Learning. 

In this Center, basic research is done to extend knowledge about 
the processes of cognitive learning, particularly those associated with concept 
learning and problem solving, and about the conditions ossocioted with efficiency 
of learning in the cognitive domain. Some of this knowledge goes immediately 
into the development of instructional systems. A second objective of *he Wiscon- 
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sin R & D Center is the improvement of educational practices in the cognitive 
domain. The development and refinement of an instructional system related to 
a subject field, such as mathematics, requires appropriate strategies for dealing 
with the various components independently and also for interrelating them to 
that desired behavioral objectives are achieved. Three impoitunl components of 
the system are subject matter content and sequence; instructional materials and 
media; and instructional methods, including teacher behaviors and learner activi- 
ties. A colloquium series was organized to bring information to the Center staff r ' 
regarding these research and development strategies. 

One part of this colloquium series was concerned with research on 
learning that has fairly direct implications for improving education. (A previous 
volume. Analyses of Concept Learning, Academic Press, 1966, on the other hand 
outlined more basic research.) The main portion of the colloquium series was ' 
addressed to development and related research dealing with subject matter con- 
tent and sequence, instructional media, and instructional methods. This volume 
is organized in the same pattern. 

As might be expected, the research methods reported by the partici- 
pants are varied. In Part I, Endel Tulving of the University of Toronto shows that 
substantive results concerning information storage and retrieval, derived from the 
typical controlled laboratory experiment, require us to reconsider our notions about 
why persons do not effectively reproduce information they once learned. Kenneth 
Lovell, University of Leeds, shows that the charting of thought processes develop- 
mental^ it moving ahead rapidly by means of Piaget's methods and refined vari- 
ants thereof. Marlin Covington, University of California, describes a straightfor- 
ward attempt to develop materials designed to facilitate productive thinking in 
school children and to utilize tho material in extending knowledge about chil- 
dien's productive thinking skills. Here there is a continuous interweaving cf theor- 
izing, developing material based on theory, and research activities concerning 
the abilities nurtured by the instructional program. Richard DeCharms and Vir- 
ginia Carpenter of Washington University and lindenwood College proceed in a 
simifior manner as Covington; however, their main concern is with motivational 
theory and the measurement of strength of motivation in culturally disadvantaged 
children. In these chapters substantive research results and theory properly receive 
most attention; however, sufficient attention is given to the procedures to make 
dear that extending knowledge about processes and conditions of learning can 
be accomplished by a variety cf strategies. 

In Part II, somewhat similar c 'fknlum development and research 
procedures are outlined by the first three i * O. Regie, Stanford Univer- 

sity, outlines development and related research in mat, tmalics, including his expe- 
riences with the widely known School Mathematics Study Group. Arthur liverriore, 
AAAS Commission on Science Education, briefly describes the large science cur- 
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riculum projects, kindergarten to Grade 12, but gives major attention to the 
elementary program! Science — A Process Approach . Robert C. Pooley, The Uni- 
versity of Wisconsin, also synthesizes many research and development activities 
related to the teaching of literature, composition, and language but gives par- 
ticular attention to the Wisconsin English-Language Arts Project. Common to the 
curriculum development strategies in these subjects is an increasing emphasis on 
the structure of the discipline and a decreasing emphasis on other criteria such 
as social utility, difficulty, children's interests, and possible transfer to other sub- 
ject fields. In the last two chapters of Part II, Wayne Otto, The University of Wis- 
consin, describes a rigorous and productive research effort in reading, and Myron 
Rosskopf, Teachers College, Columbia University, relates curriculum development 
in mathematics to recent research in concept learning. 

In Part III, Wilbur Schramm, Stanford University, reports information 
on the use of instructional television. Three case studies are presented in suffi- 
cient detail to renew confidence in the value of careful observation in the natural 
environment by an interested, objective scholar. Lawrence Stolurcw, Harvard Uni- 
versity, describes the computer-based instructional system, SOCRATES, that he 
developed while at the University of Illinois. Problems associated with develop- 
ment of the hardware ard software are noted briefly or may be inferred. The use 
of the computer in research to improve instruction and to validote behavior theory 
is noteworthy. Arthur Lumsdaine, University of Washington, deals with research 
and development in the entire field of instructional media. 

In Part IV, N. 1. Gage, Stanford University, outlines a recent con- 
cept, micro-teaching, and related research strategies. The concept orp-nises to 
generate much research and development on instructional methods. In t, ( ;roach, 
the teacher and student rather than the content, hardware, or pr jrom, are 
central In the educative process. Ned Flanders, University of Michigan, describes 
the new directions of his long-standing research on teacher-student interaction anal- 
ysis. In the current model, the number of categories of interactions is reduced. By 
employing a computer for rapid feedback, the current model holds much promise 
of providing immediate (daily) correction of teacher-student interactions and also 
for supplying the extensive research data required in validating and extending 
the theoretical basis of the systsm of inleroctio i analysis. 

Part V of this volume contains p< » *rs which did not arise from the 
colloquium series. They are included because th< >- contribute to the survey of 
rr*earch and development activities in ed‘ '‘b particularly very r' "*nf trends. 
Louis Bright and Hendrick Gideonse of the U.S.ol affine the broad w*ep of 
research and development strategies and activities, i«sjlting from the passage 
of the Elementary and Secondary Education Act of 1965. Included here are the 
RAO centers, regionol educational laboratories, Title III centers, and other RAD 
instrumentalities funded by other governmental agencies. The comprehensive edu- 
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cotionol research and development program of the U.S.O.E. merits careful atten- 
tion by anyone interested in the improvement of education. A more complete 
description of one federally-supported R & D instrumentality, the Wisconsin Re- 
search and Development Center for Cognitive learning, follows the chapter by 
Bright and Gideonse. Here we review the main components of a Center and their 
interrelations. Particular attention is given to the problem area of the Center; 
its programs, strategies, and outcomes; staffing pattern; administrative organi- 
zation; locus of operation; and source and stability of funding. 

In a new field, models are required as guides to operations. Many 
models have been outlined to indicate how systematic improvement in education 
might be managed through sequential research, development, and dissemination. 
None of the models thus far appeared particularly appropriate to the current scene. 
Hendrick Gideonse, active privately and not as a U.S.O.E. official, has been 
attempting for some lime to formulate a comprehensive model that would simul- 
taneously meet the test of reality and also provide a more adequate conceptuali- 
zation of Research and Development activities designed to improve education. 
Fortunately his conceptualization was completed at the time the volume was in 
final editing. The Gideonse model is especially relevant to those who have been 
concerned with reloting research, development, and educational improvement. 

The colloquium series was planned and executed by the editors of t.iis 
volume; Herbert J. Klausmeier assumed primary responsibility for organizing the 
colloquium serirf around topical areas of relevance to the R & D Center. He identi- 
fied most of the participants and the broad organization framework for each par- 
ticipant's contribution. George T, O'Hearn participated in the planning and organi- 
zation of the colloquium series, worked out the presentation schedule and other 
details with each participant, ond handled editorial queries from the publisher. 
He also edited the papers and wrote the introductions to each part. Barbara 
Kennedy, Pro]ect Assistant, read the papers, checked the references, and put 
the references in APA style. The Wisconsin Research and Development Center for 
Cognitive learning, the education research and development community, and 
the teaching profession generally is indebted to the infernationnllv recognized 
scholars who made this volume possible. 



Herbert J. Klausmeier, Professc. r of 
Educationol Psychology; Director, 
Wisconsin Research and Development 
Center for Cognitive learning 

George T. O'Hearn, Associate Professor, 
Acting Director, Division of Education 
University of Wisconsin-Green Boy 

September 1968 
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PART I 



MiiBlil Conditions and Protossos of Learning 



UNDERSTANDING [earning phenomena and conditions associated 
with efficiency of learning is a foremost concern of psychologists throughout West- 
ern civilization. Increasingly sophisticated experiments are being executed in labo- 
ratory and non-laboratory settings. Representative of work in this vast domain, 
with implications for education, are the following: 

a) controlled observations to infer thought processes. 

b) controlled experimentation in the laboratory to extend our knowledge of 
human memory. 

c) development of material and related research to nurture the creative abili- 
ties of school children. 

d) development of dependent measures to extend a motivational theory to 
school settings. 

Permanence of learning necessarily requires the storage and recall 
of information. In Chapter 1, Endel Tulving discusses various verbal learning and 
memory experiments conducted in the laboratory at the University of Toronto, 
and suggests that "the success of retention and recall is to a large extent deter- 
mined by what the subject does with the material he is to memorize, by the meth- 
ods he uses to organize the material, and by the cues that he uses to effect the 
recall of the material." The data reported by Tulving support his contention that 
the ability to recall is determined more by the limitation of the retrieval mechanism 
than by the limitation of the storage mechanism. He concludes: 

. . . that understanding of many phenomena of verbal learning and memory would 
be enhanced if we adopted a basic orienting attitude. That a person's mnemonic perform- 
ance depends to a very large extent on the method that he wittingly or unwittingly 
uses to organize the material. The important function of such organization is to facili- 
tate retrieval of information from Ihe memory storage. 

The inferring of thought processes has always been difficult but is 
essential to explaining changes that occur onfogenetically. In "Developmental Proc- 
esses in Thought," Kenneth Lovell, University of Leeds, reports on the stages of 




human intellectual growth hypothesized by Jean Piaget and his followers. Lovell 
suggests that the schemas interiorized by the child undergo constant modifica- 
tion and are the basis and limitation of all subsequent learning. "The implication of 
Piaget's findings is that we need to begin to stimulate the intellectual growth of 
the child in the early weeks of life." Research reported by Lovell confirms the 
general classification of the developmental stages of thought hypothesized by 
Piaget, and also indicates the importance of previous learning and the cultural 
milieu on the child. 

Martin Covington in his paper "Promoting Creative Thinking in the 
Classroom" states, "In order to take full advantage of the unrestrictive atmos- 
phere the child must first come to understand what constitutes creative ideas in 
the given situation, and how he ran achieve such ideas for himself ... In order 
to think creatively the child must have at his disposal a repertoire of creative think- 
ing skills. To name a few; the ability to recognize gaps in exist' <g information; a 
facility for formulating relevant questions, and a facility to the demands of the 
task so one can adequately judge the suitability of the proposed ideas." 

The General Problem Solving Program described by Covington repre- 
sents an attempt to initiate creative thought in students within a school setting 
and within a curriculum framework. The objective is to teach a number of cog- 
nitive skills which are fundamental to creative thinking and then determine whether 
such generalized skills can be applied to a specific subject matter area. 

Before specified learning can take place the learner must seek and 
accept the learning situation. The probability that an individual will seek or ac- 
cept a new learning situation is referred to as motivation by Richard deCharms 
and Virginia Carpenter. When a tendency to avoid a learning situation increases, 
i.e.., when there is a lack of motivation, the problem becomes crucial. The dis- 
cussion of this problem by deCharms arid Carpenter is based on their work with 
inner-city youngsters. In their chapter "Measuring Motivation in Culturally Disad- 
vantaged School Children" the authors propose a model of motivation in which 
a person perceived to be originating his own behavior is called an "Origin" while 
a person perceived to be behaving in a certain way because ?f an external "power 
source" is said to be acting like a “Pawn." "Pawn behavior implies powerless- 
ness, but origin behavior implies freedom of choice, not necessarily the ability to 
wield power over others.” The theoretical framework of the "OP” model is dis- 
cussed in detail. The n achievement procedures developed by McClelland were 
used in measuring motivation in a sample of culturally disadvantaged school chil- 
dren. The data obtained tend to support the theoretical point of view expressed. 
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Organiied Retention and 
Cued Recall' 



Endel Tuiving 



University off Toronlo 
Toronto, Ontario 



EVER SINCE Hermann Ebbinghaus 
(1885) brought phenomena of memory under experi- 
mental scrutiny In the psychological laboratory and 
William James (1890) eloquently epitomized the dis- 
tilled wisdom of other great thinkers on the subject, 
research on remembering and forgetting has been 
growing by leaps and bounds. Everyone agrees that 
this research has by now produced an Immense quan- 
tity of empirical data, but few are willing to claim 
that it has created any genuine novel conceptual in- 
sights. More often than not, new empirical findings 
have generated more heat than light at the theoreti- 
cal level. Thus, despite everything we believe we 
know about the role of a multitude of experimentally 
manipulable variables on verbal learning, retention, 
and recall, we 6eem to be no nearer to the under- 
standing of the basic nature o! memory than were 
psychologists and other writers of previous genera- 
tions. If someone asked us today what do we know 
that is truly worth knowing and that was not known 
to Ebbinghaus and Jatr.es, we would be hrrd pressed 
to provide a convincing answer. 

Those who share this pessimistic assessment of 
the state of affairs In research on verbal learning 
and memory have been quick to suggest remedies, 
but their advice has been Inconsistent. Some have 
argued that experimental conditions between labora- 
tories be more rigidly standardized, others would 
Like to see a greater diversity of methods. Some ad- 
vise that only limited sets of carefully calibrated ma- 
terials be used, others insist on a fuller variety of 
materials. Some are convinced that true understand- 
ing of memory can be achieved only through mam- 
moth parametric studies, others are equally certain 



that at least for the tinv, being the solution lies in 
simpler “miniature” experiments. I am listing 
these conflicting attitudes not to pass judgment on 
them, but ratb^r as a background for my own favor- 
ite complaint about the general orientation of re- 
search In this broad field. 

My complaint is that far too little attention has 
been devoted to the Implications of the well-known 
fact that subjects In verbal learning and memory ex- 
periments are not passive organisms. Too many 
students of human learning and memory have predi- 
cated the interpretation of their data and the formu- 
lation of their theoretical statements on the basic 
assumption that in learning and remembering cer- 
tain things happen to the person or certain events 
take place In his nervous system, and that these 
events are governed by nothing more than the present 
and past Inputs. Eventually, of course, science may 
be able to interpret all phenomena of memory with- 
out recourse to a highly sophisticated, conscious, ac- 
tive, thinking organism, but at the present time 
nothing much seems to be gained, and a good deal 
may be lost, if we pretend that the articulate human 
subject is a passive recipient of external stimula- 
tion, and that acquisition, retention, recall, trans- 
fer, interference, etc., occur In a mental vacuum. 

If we know anything at all about what subjects do In 
verbal learning and memory experiments, we know 
that they use plans (Miller, Galanter, and Pribram, 
1960), that they consciously and deliberately employ 
strategies (e.g. , Pollack, Johnson, and Knaff, 1959) 
or mediatlonal devices (e. g. , Bugelski, 1962; Un- 
derwood and Schulz, 1960), or simply thatthey think 
(e, g. , Mandler, 1965). There are some who would 
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argue that these covert activities of the subject, and 
the Lr behavioral manifestations, merely accompany 
processes of memory and that ihey play no signifi- 
cant role In determining the quantity and quality of 
a person's mnemonic performance, but such views 
are rapidly losing their appeal. A great dealof evi- 
dence accumulated In recent years, added to evi- 
dence resurrected from isolated and forgotten ex- 
periments from the past, points to the witting or un- 
witting use of plans, strategies, and mediational de- 
vices by the subject as the sine qua non of remem- 
bering. A fuller understanding of what the subject 
does when faced with the requirements of memory 
tasks M various kinds, therefore, seems Indispensa- 
ble f^r the comprehension of many, If not all, phe- 
nomena of memory. In all probability, an active 
search for such understand! ng will turn out to be 
more fruitful than the mere Introduction of standard- 
ized conditions of experimentation, calibration of ma- 
terials, or mammoth experiments. 

Tn the present paper I w 11 describe some recent 
work we have been doing at Toronto to probe Into 
some of the long-standing problems of memory. 
Two questions that I have been particularly inter- 
ested In are, first why Is repetition effective In In- 
creasing the amount of material the subject can re- 
call, and secondly, how does retrieval of mnemonic 
Information from the memory storage take place. I 
will obviously not be able to answer these questions, 
but I would like to offer some suggestions relevant 
to them. These suggestions are firmly anchored to 
the basic assumption that the success of retention 
and recall Is to * large extent determined by what 
the subject does .. Ith the material he Is to memorize, 
by the methods he uses to organize the material, 
and by the cues that he uses to effect the recall of 
retained material. The data I will report, I believe, 
will offer good support to this assumption. 

FREE RECALL AND ORGANIZATION 

The experimental data come from experiments In 
which the subject's task is to learn, that Is to com- 
mit to memory, a net of discrete v e rba 1 items. 
Some of these experiments are concerned with free 
recall of Items, while others constitute variations 
on the theme of free recall. In the free-recall ex- 
periment the subject Is presented with allst of 
familiar Items, such as meaningful words, and his 
task Is to remember as many of these Items as pos- 
sible, In any order that they occur to him. Thus the 
free-recall paradigm constitutes a test for the ac- 
quislton, retention, and utilization of retained infor- 
mation about the membership of otherwise familiar 
Items In an unfamiliar set. Free recall as a labor- 
atory task, like other paradigms of verbal learning 
and memory, Involves mnemonic performance of the 
kind often required of Individuals outside the labora- 
tory. A teacher’s knowledge of names of students 
In a class, a person’s memory for the names of 
guests at a cocktail party he attended the night be- 
fore, and a child's recollection of animals he saw on 
his visit to the zoo are based on retention of Informa- 
tion of the kind that we Investigate in free-recall ex- 
periments. 

I have been particularly Interested In free-recall 
phenomena for three reasons. First, the require- 



ments Imposed on the mnemonic Information proces- 
elng mechanisms In the free-recall task are neces- 
sarily present In any other paradigm. The subject 
cannot learn the order of a set of Items In a serial 
learning task, or specific Inter- Item associations In 
a paired-associate lasl;, unless he knows what items 
constitute the set. This means that the processes in- 
volved In free recall are lr. .<cme ways more basic 
than those underlying many other laboratory tasks In 
memory, and that thereiore the study of these proc- 
esses coistltutes a logical starting point for the 
study of memory. Secondly, free-recall phenomena 
were ignored by students of verbal learning and 
memory for a long time. As a consequence they 
have not yet been fitted into a relatively fixed theo- 
retical framework as have been oci lal- and paired- 
associate learning phenomena. Thus, when wc are 
faced with the problem of Interpreting experimental 
findings in free recall, we fire not hampered by ex- 
tant theoretical notions. Thirdly, and most Impor- 
tantly, it is easier to find out In free-recall situa- 
tions what the subject is doing when he Is memoriz- 
ing a set of Items. The task set to the su b j e c t In 
serial- and paired -assoc late paradigms Is too rigidly 
prescribed by the experimenter and all that c r.n be 
observed at the behavioral level is how well the sub- 
ject can meet the experimenter’s requirements. In 
free recall, the subject Is told to recall as many 
Items as possible, but he Is le:!t free to recall the 
Items in any order. Examination of the ord e r In 
which he recalls the items provides considerable in- 
sight into the subject’s covert activities In the proc- 
ess of memorization. 

In multi-trial free-recall tasks, the same set of 
Items Is presented on a number of successive trials, 
the order of presented Items usually varying from 
trial to trial {cf. Waugh, 19£1), and after each input 
trial the subject recalls all Items he can. v/hen the 
number of items the subject recalls are plotted 
against trials, a typical negatively accelerated learn- 
ing curve results {Miller and McGill, 1952; Murdock, 
1960; Tulvlng, 1962a, 1964;Waugh, 1961). One of 
the questions I wish to raise Is, why does such learn- 
ing, l. e. , improvement In trial- to- trial recall, oc- 
cur. I have argued elsewhere (Tulvlng, 1962a, 1964) 
that learning In multi-trial free recall is a conse- 
quence of the fact that the subject organizes list- 
items into larger units of material, :mto subjective 
units or S- units. At any given time the subject car. 
retrieve from memory only a limited number of units 
of a particular set of materials, but the larger these 
units, that Is, (he more Individual Items each unit 
contains, the larger the number of Items rec ailed 
(Miller, 1956a, 1956b). 

ORGANIZATION AND LEARNING 

The original evidence for this contention was pro- 
vided by the observations that the amount of organi- 
zation subjects Imposed on the material Incrersed 
systematically over trials, accompanying the In- 
crease in the number of Items recalled, and (hat 
when the amount of practice was held constant, there 
was a sizable correlation between recall scores and 
organization scores as subject variables. Such cor- 
relational evidence, of course, is not vory compelling. 
One can Justifiably argue that organization and rec til 
are two parallel but otherwise unrelated manifesta- 
tions of some common underlying mechanism. Some 
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writers (e. g. , Asch and Eben holt z, 1962) have In- 
deed claimed that free-recali learning occurs Inde- 
pendently of any inter- Item associations, being a 
conseque ice of greater availability of Items result 
ing from repeated presentation of It e m s . To the 
extent that the development of S-unlts reflects the 
development of specific inter- item associations, the 
denial of the primary role of inter- Item associations 
in free recall learning a Iso constitutes a denial of 
the dependence of learning on organizational proces- 
ses. How can we e/aluate the hypothesized relation 
between organization and fr.-e-recaH leaguing: more 
directly than is possible on <.he basis of observed 
lorrelatlons between the two measures? 

Two possibilities suggest themselves. The first 
is t> present a set of items to the subject under con- 
ditions wher* ha makes repeated responses to the 
items, b.it f .'v,- not actively and deliberately iry to 
organize the material into larger S-unit j. If learn- 
ing depends upon organlza* On, then such non-di- 
rected repetition should have little effect on recall- 
abillf.y of items. The second pos s lb 11 lty is to in- 
struct subjects louse effective methods of organiza- 
tion. If leairit.ig depends on organization, such in- 
structions wo\ld be expected to facilitate learning. 
We have do.ic both types of experiments. 



KZPITI710M AND ORGANIZATION 



At first glance, it may s-em dltilcult to create 
conditions under v hlch subjects are repeatedly 
exy^sed to a set of Items and whe; they make overt 
responses to these Items, tut do not think about and 
thus organize the Items. Since we initially knew 
nothing about the problems Involved, we decided to 
start with the meet obvious approach, altnough I 
must admit, at the time we did not have much faith 
in It. Subjects were simply shown a set of common 
words, asked to read these words aloud a number of 
tirres, and then, immediately after such reading, 
were given the same set of words to learn under the 
typical free- recat L instructions rTulv /ig, 1966). A 
cortrol group leaned the same set of words under 
identical conditions, but without having seen the 
words beforehand. 

The list to be learned contained twenty-two high- 
frequency English words. In the “reading task,' 1 
the subjects In one group were shewn each of the 
wc rds six times, in an uninterrupted sequence of 132 
exposures. The words were exposed one at a time 
by means of a memory drum, at t he rate of one 
word/second, and the subjects we re Instructed to 
ca LI out each word as it appeared. The subjects in 
the other group went through the s am e procedure 
with a list of twenty-two names. Immediately follow- 
ing the reading task, all subjects we r e asked to 
learn the same set of twenty-two words to which the 
first group had beer, exposed already. Typical free- 
recall Instructions were given, words were pr e- 
8 anted at the rate of one word/second, and at the 
end of each input phase subjects had 60 seconds for 
oral recall. Every subject received twelve learning 
trials. Thus, both groups learnedthe identical list 
of words under Identical conditions. The only dif- 
ference was that the subjects in the Prior Acquaint- 
sr.ee Group has Just finished reading aloud the same 



FIGURE 1. Learning curves for two groups of sub- 
jects. One group received six trials of pr io r ac- 
quaintance with the set of twenty- two words to be 
learned later, the othei group had no such prior ac- 
quaintance. 
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words on si x continuous reading ‘'trials, “while the 
subjects tn the No Prior Acquaintance Group had 
been “warmed u/’ with a di'terent set of words. 

The two Lean ing curves f, o m this experiment 
are shown hi Figure 1. The Prior Acquaintance 
Group had a small, but statistically non significant 
edge over the No ?rlor Acquaintance Group on the 
very first trial, but none there after . Over all 
twelve trials, the mean number of words recalled 
by the former group was *3. VI, white themeannum- 
ber of words recalled by the Latter group was 15. 91. 

These rest .Its thus suggest that mere repetition 
of list items hjd no effect on subsequent memoriza- 
tion of these items. According to the present Inter- 
pretation, repetition had no effect because the sub- 
jects did not attempt to organize items In any way. 
Post- expert mental interviews revealed Indeed that 
very few subjects had thought that they might be 
asked to recall the words they were reading in the 
original reading task. Most of them said they 
thought the experimenter was Kterestedlnhow well 
they could read, how fast they could read or how 
clearly or consistently they could pronounce the 
words. 

Although we did not give an Immediate recall test 
to the subjects at the end of the preliminary reading 
task, It is extremely unlikely that they would not 
have remembered any words that they had seen. 
Thus, this experiment does not provide any evidence 
against Incidental lejrning measured in a single re- 
call test following a reading task of the kind we used. 
It only demonstrates that directed memorization un- 
der the conditions of free recall is not facilitated by 
whatever prior Incidental learning has occurred. 
This is not a surprising result, if we assume that 
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no organization occurs during the reading task, that 
Incidental memory of ltem3 read, therefore, would 
Involve ludlvHual Items as S-unlts, and that the sub- 
ject can only recall a constant limited number of S- 
unlts on any given trial In free recall. If the subject, 
on the first trial In the directed le ar n In g task, re- 
calls some of the items he learned Incidentally, he 
could not recall too many other items because his 
limited retrieval capacity would already be partially 
exhausted. One of the Implications of these findings 
lb that if the subject, before the pr e se ntat 1 on of 
a longer list for directed recall, were told what seme 
of the Items in the list are, his recall would be no 
greater than that of the subject who has no such prior 
information, provided the items; re not meaningfully 
related to one anr thcr and that the rate of presenta- 
tion is rather fast. The hypotheses that increased 
recall car. occur only as a consequence of organiza- 
tion and that the retrieval capacity lo 1 1ml ted to a 
fixed number of S-unlts would completely account for 
this tinging, ^ven though it could not be readily pre- 
dicted from many other theoretical points of view. 

ALPHABETICAL ORCANflAilON 

TV second typ of more direct test of the rela- 
tl'n between learning and organization, as I said, Vi- 
vo Ivas manipulation of organizing strategies through 
Instructions to subjects. An Initial study of this kind 
was done as a classroom experlm mt (Tulvtng, 1962b) 
The subjects were eighty unlvers'ty students. They 
had tj learn a list of vweuy- lv/o nouns, each begin- 
ning with a different letter, and the whole .set cover- 
ing u wide range of Thorndike- Lorge (1944) frequen- 
cies. Tn the input phase of each trial, words were 
projected on a screen at the rate of 1. 5 second/word. 
In each output phase of 90 seconds duration subjects 
wrote down as many words as they remembered. 

At the beginning of the experiment, ail subjects 
were given typical free-recall instructions. For the 
first three trials all subjects worked under these 
identical instruct'Dns. Before the fourth tr ial, 
subjects were asked to open and read additional In- 
structions on folded sheets handed out to them before 
the experiment. For half the subjects, the Instruc- 
tions simply reiterated wh-.t all subjects had been 
told at the beginning of thf experiment, name ly to 
“do your very best on ea *h recall trial and put down 
as many words from the list as you can. M The in- 
structions for the other half of the subjects read: 
“Try t‘< organize your rec a lied words alphabetically. 
When you look at the words on the screen, note thc : r 
first letters, and make an attempt to associate the 
word with the letter. When you write the words 
down, go through the letters of the alphabet o n e at 
a time and try to remember the word that goes with 
each letter. ” Subjects in each group, the Standard 
Group and the Alphabetical Group, were given 30 
seconds to read these additional instructions. The 
experiment was then continued under otherwise iden- 
tical conditions for eight more trials. 

The learning curves for the two groups are shown 
in Figure 2. For the first three trials, when both 
groups worked under identical standard instructions, 
the curves are almost indistinguishable indicating no 
differences In learning “ability” of the two groups. 



FIGURE 2. Learning curves for two groups of sub- 
jects. After Trial 3, one group was given Instruc- 
tions to recall the woids alphabetically, while the 
other group continued learning undor standard in- 
structions. 




From Trial 4 on, however, the curves draw rrpldly 
apart, the mea-i number of words recalled by the 
Alphabetical Group on Trial 5 equaling that of the 
Standard Group on the Jast trial of the experiment, 
Trial 11. Judging by the shape of the curve of the 
Standard Group, It appears that it would have taken 
them many additional trials to reach the level of per- 
formance comparable to that reached by th e Alpha- 
betical Group on Trial 6. The differences between 
the two groups would undoubtedly be even greater if 
it were not for the artificial limit on the perform- 
ance of the Alphabetical subjects Imposed by the 
“celling effect. ” 

These results clearly i/dlcate that methods of or- 
ganization are very Important in d e t e r m l n l ng the 
course of memorization of a list of items. A1 pha- 
betical organization is apparently much more effec- 
tive In this type of task than are other methods of 
organization - grouping of wordsby their meaning *- 
used by the subjects in the Standard Group. The 
learning curve of the subjects in the Standard Group 
reflects their limited performance, but the limit is 
net woolly determined by their Inadequate mnemonic 
ability. To a large extent, it Is deter mined by their 
Ignorance as to how to make best use of their mne- 
monic ability In this type of task. When subjects 
are given more powerful organizing ins tr uc t Ions, 
their “ability” increases considerably. 
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One important implication of this observation - 
1 am now going to digress somewhat from my main 
theme - has to do with the problemof individual dif- 
ferences Ir learning ability. It Is commonplace to 
study Individual differences in learning abl lity by 
dividing subjects Into “fast” and “slow” learners 
on the basis of their performance in a learning task, 
and then look for similar differences between the 
two groups In various other situations, such as var- 
ious psychometric tests. In the experiment 1 have Just 
described, there were pronounced differences in the 
memorization performance between the subjects In 
two groups, but since the groups were selected ran- 
domly It Is a foregone conclusion that they would 
have shown no differences on any other tests. How 
frequently are Individual differences In 1 e a r n I n g 
“ability” determined by the same factors as those 
manipulated In the present experiment? The long 
history of failures to find powerful psychometric cor- 
relates of learning performance, or sizeable corre- 
lations between different learning tasks, suggests 
that Individual differences In learning “ability” may 
be largely governed by Individuals’ knowledge of ef- 
fective strategies of handling a particular task, rath- 
er than by the sheer goodness of their memory. At 
any rate, In the light of data from this experiment it 
seems that If we wish to add to our understanding of 
Individual differences in learning “ability, ” a good 
place t > start Is to analyze the learners’ strategies 
of memorizing In a given learning situation, and not 
to observe his behavior In some other extra-experi- 
mental situation. 

ORGANIZATION AND LEARNING 

Let me now return to ine relation between organ- 
ization and ’earning. Y/e have seen that when a sub- 
ject has to memorize a list of randomly selected 
words, alphabetical organization fs more effective 
t^o other methods of organizin'., Alphabetical or- 
ganization changes the task into a kind of paired as- 
sociate learning task. The initial 1 ette r of each 
word serves tit a cue for the recall of the whole word 
The exper ime 'ter does not have to p r e s e n t these 
cues since an articulate subject can generate them 
on his own. Y,'c could say that In alphabetical organ- 
ization each Input word Is cued with respect to Its 
initial letter r.:;d that Its retrieval Is facilitated by 
the availability of relevant cues. When other meth- 
ods of organization are used, such a 3 grouping of 
Items in terms of their associative meaning, their 
belongingness 1 to eui/erordlnate conceptual catego- 
ries, or the degree o the’r prior familiarity, input 
words are cued with respect to their properties oth- 
er than the InRlel letter and their retrieval Is pre- 
sumably effected through these other cu^s. It Is pos- 
sible, of course, that a given word Iscuid In sev- 
eral ways and that the way U Is cned changes In the 
course of the experiment, but under the usual time 
pressure in a typical experiment, multiple cueing Is 
probably an exception rather than a rule. 

Suppose now that a subject has been exposed to a 
set of Le.ns for a number of trial 3, that he has not 
discovered alphabetical method of organization, and 
that he has been cubing the words In terirs of their 
other characteristics. What would happen, If the 
subject were now told to switch to another method 
of organization, say alphabetical organization? We 



know already that alphabetical organization is likely 
to be more effective than other methods of organiza- 
tion and that therefore alerting the s u b j e c t to It 
should facilitate learning. But It Is also possible 
that changing the method of organization requires not 
only the adoption of the new strategy , "but also ihe 
suppression of the pre/lously used strategy. One 
might expect, therefore, that immediately after the 
introduction of alphabetical Instructions thp effi- 
ciency of the storing and retr leval mechanisms 
13 temporarily reduced and that the disturbance Is 
the greater the more highly developed the non- alpha- 
betical organization. 

Data relevant to these hypotheses come from an 
experiment done by Marcia Ozler as part of her PhD 
thesis (Ozler, 1965). Her subjects iearneda list of 
twenty- two words, each beginning w 1 1 h a different 
letter. Words were projected on a screen at the 
rate of 1. 5 second/word and subjects rerorded their 
recall on paper-pullers that prevented them from 
seeing more than one word of their recall at a ny 
time. The duration of output phase of each trial was 
90 seconds. 

Most subjects were Initially given standard free- 
recall Instructions and then switched over to alpha- 
betical Instructions at some point In the experimen- 
tal sequence. The two Independent variables In the 
experiment were, first, the ordinal number of the 
“critical” trial on which alphabetical Instructions 
were given, and second, pre- Input versus post- In- 
put alphabetical Instructions, Different groups of 
subjects were tflven alphabetical Instructions on Tri- 
als 1, 5, 9, 16, and 21. In each of these gr o up s, 
half the subjects were given alphabetical 1 n s t r u c- 
tlons before the Input phase of the c r it l c a 1 trial, 
while the other half received these Instructions after 
the Input phase, that Is, before the output phase, of 
the critical trial. Before the critical trial, subjects 
In a given group worked under standard free-recall 
Instructions. Thus, for Instance, one group of sub- 
jects worked under free- recall Instructlonsfor eight 
trials, then received alphabetical Instructions, fol- 
lowed by the Input and output phases of the ninth and 
subsequent trials. Another group wo r ked under 
standard free-recall Instructions for eight trials, 
was then shown the words in the input phase of the 
ninth trial, and then was asked to start recalling 
words in the alphabetical order, beginning with the 
Immediately following output phase. There was thus 
a total of ten independent groups, w 1th twelve sub- 
jects per group. Scoring was lenient; even If the 
subject had deviated somewhat fromthe alphabetical 
order when he was supposed to recall the words al- 
phabetically, he was given credit for each word cor- 
rectly recalled. Subjects who obviously did not fol- 
low alphabetical instructions, however, were re- 
placed. 

The somewhat schematized results of this exper- 
iment are st.own In Figure 3. The upper heavy 
smoothed curve shows the learning curve for the 
subjects who received alphabetical instructions be- 
fore Trial I, the lower heavy smoothed curve rep- 
resents the free-recall conditions. Subjects who 
had received pre-input alphabetical instructions on 
Tiial 1 had a mean recall of approximately eight 
words on that trial, while those who had received 
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FIGURE 3. The effect of alphabetical organizing 
Instructions given at various points In the course of 
learning. See text for explanation. 




post-input alphabetical Instructions on Trial 1 re- 
called approximately five words, a difference of 
three words. The learning curvefor the latter group 
is not shown on the graph. It reached the learning 
curve of the former group by the fifth trial, being 
practically identical with it thereafter. 

The other data in Figure 3 show the initial drop 
and subsequent rapid recovery in recall of grorps 
who were given alplabetical instructions at Trials 
5, 9, 16, and 21. For each of these groups, with 
the exception of those for whom Trial 21 was the 
critical trial, mean recall scores are shown for five 
trials after the critical trial. These data show, 
first, that immediately after the introduction of al- 
phabetical instructions there is a drop in perform- 
ance - with the exception of pre-input instructions 
on Trial 5 - with the magnitude of the drop varying 
directly with the ordinal number of the critical trial 
and being consistently greater for post-input alpha- 
betical instructions, and second, that the subsequent 
recovery of the effectiveness of alphabetical Instruc- 
tions given on the critical trial varies inversely 
with the ordinal number cl the critical trial. 



The percentage loss in recall in the first output 
phase following the introduction of alphabetical in- 
structions Is plotted as a function of the ordinal num- 
ber of the critical trial, for both pre-input and post- 
input instructions, in Figure 4. Each data point In 
this graph represents the mean difference in recall 
between the number of words recalled on the critical 
trial and the Immediately preceding trial divided by 
the mean number of words recalled on the Immediate 
pre- critical trial. The data plotted In Figure 3 
showed that the drop In performance after the Intro- 
duction of alphabetical Instructions, measured in 
terms of absolute number of items, varied directly 
with the ordinal number of the critical trial. The 
data shown In Figure 4 indicate that the same rela- 
tion holds between percentage loss In recall and the 
ordinal number of the critical trial. 



From previous experiments we already know that 
organization of material increases over trials of 
practice in the tree-recall situation (Bousfield, Puff, 
and Cowan, 1964; Ehrlich, 1965; Tulv Ing, 1962a, 
1964). Therefore, manipulating the temporal point 
at which subjects are switched from other forms of 
organization to alphabetical organizationessentially 
amounts to manipulation of the degreeof existing or- 
ganization that has to be changed. The results of 
Ozler's experiment suggest that the stronger the 
pre-existing organization, that is, the more firmly 
the list- items are cued with respect to characteris- 
tics of words other than their Initial letter s , the 
more disruptive is the requirement that the subject 
change his system of cueing and the longer it takes 
for the otherwise powerful alphabetical system of 
organization to become effective. 



AVAILABILITY AND ACCESSIBILITY 
OF STORED INFORMATION 

1 have so far talked about two general classes of 
methods of organization: organization of words into 
larger groups in terms of their perceived, discov- 
ered, or fabricated meaningful relations to one an- 
other; and organization In terms of structural 
features ot words, such as Initial letters. In either 
case it Is as If words stored in memory - or infor- 
mation about words to be reproduced - are in stor- 
age in a way that would facilitate retrieval: two or 
more related words are stored In or near the same 
location, such that when the retrieval mec han i s m 
finds one, the other one is also easily located, or 
else a word Is stored In a location In which itB initial 
letter is stored. Thus, one part of the stored In- 
formation can be thought of as a retrieval cue for an- 
other part. Organization of information In the stor- 
age, howi 'er, can facilitate retrieval only to the ex- 
it t that retrieval cues are available at the time of 
recall. Alphabetical organization is more effective 
than organization of items In terms of their semantic 



FIGURE 4. Percentage loss of recall on the trial 
Immediately following the Introduction of alphabet- 
ical organizing instructions, as a function of the 
“critical” trial on which alphabetical Instructions 
were given. 
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features because the initial letters of the words, 
serving as retrieval cues are readily available to the 
subject at the time of recall. 

This kind of speculation Implies that organization 
of material in the memory storage, or organized 
retention, does not necessarily Increase the storage 
capacity, but rather makes the stored information 
more accessible to recall by providing distinctive 
retrieval cues through which Individual Items of In- 
formation can be reached. It also implies that the 
amount of Information potentially available in the 
storage at a given time may be greater than is ap- 
parent in typical unaided recall. In other words, 
limitation of memory Is primarily deter mined by the 
limited capacity of the retrieval mechanism and not 
necessarily by the limited capacity of the storage 
mechanism. 

Tn experiments of the kind that we have examined 
so far it Is Impossible to distinguish between reten- 
tion and recall. If a subjectusing alphabetical or- 
ganization can recall more words than an otherwise 
comparable subject who uses less efficient methods, 
we do not know whether this difference Is attributa- 
ble to differences In retention or only in recall. It 
Is possible that both subjects have retained the same 
number of words and that the alphabetical organizer 
simply has access to a larger number of r e t a i n ed 
words, but it is also possible that the alphabetical 
organizer In fact has been able to store more Infor- 
mation In his memory, that therefore more informa- 
tion Is available in the storage, and that his superi- 
or recall merely reflects the greater amount of in- 
formation that he has stored. 

The logical requirements for the analytical sepa- 
ration of retention and recall, or the discretion be- 
tween availability and accessibility of stored mate- 
rial, are simple enough. All that we need to do Is to 
present the material to be remembered to different 
subjects under identical conditions, including Iden- 
tical Instructions, and then vary experimentally the 
number of retrieval cues at the time of recall. U 
the groups are treated ideni'ealfy upto the beginning 
of the recall test, we can assume that the amount of 
Information they have stored and *hus the amount of 
Information available Is the same for all groups. If 
the number and kinds of retrieval cues giver to dif- 
ferent groups at the time of recall produce differ- 
ences in recall, thes* differences would reflect dif- 
ferences In accessibility of the stored Information 
and not differences in availability. 



In the initial experiment we did to distinguish be- 
tween availability and accessibility (Tulving and 
Pearlstone, 1966), we used a dual-level Input list, 
consisting of category names and appropriate words 
as Instances of these categories. Thns,for Instance, 
one of the lists consisted of twenty -four words In 
twelve categories, with two words per category. The 
list presented to subjects might contain items like 
this: things found on a farm - WHEAT. TRACTOR; 
nubstances for flavoring food - SUGAR, C LOVE 8; 
geological formations - PLAIN, LAKE; musical in- 
struments - DRUM, FLUTE; etc. Subjects were In- 
structed that their task was to remember as many 
words as possible, that they would be tested for the 



words only, and that they did not have to memorize 
the category names. All subjects learning a partic- 
ular list were treated Identically up to the beginning 
of the recall test. At that point, half the subjects 
were asked to recall all the words they remembered, 
he, words other than the category names, while 
the other half were presented with the c ate gory 
names as retrieval cues and asked to write down all 
the words belonging to each category that they re- 
membered from the list. 

The design of the experiment Inc luded lists of 
three different lengths (twelve, twenty -four, and 
forty-eight words) and three levels of numbers of 
words per category (one, two, and four). Within 
each of these nine conditions of presentation, there 
were then two conditions of recall, cued and non- 
cued, as I have Just described. The experiment was 
done with high-school students of both sexes as sub- 
jects, and data were collected In regular class ses- 
sions. Input material (category names and words 
to be remembered) was presented by means of tape 
recorder. The subjects wrote their recall In appro- 
priately designed booklets. The presentation tlma 
varied with the length of the list and with the number 
of categories according to the formula: T= NoC+L, 
where T Is presentation time in seconds, NoC Is the 
number of categories, and L Is list 1 e ngth. The 
amount of time given for recall was 1, 2, and 4 mln- 
utesfor lists of twelve, twenty-four, and forty- eight 
words, respectively. A total of 949 subj e c ts was 
tested, with approximately fifty -thvee subjects for 
each of the eighteen conditions of the experiment. 

The mean number of words correctly recalled 
under each of the conditions of the experiment Is 
shown in Table 1, together with corresponding 
standard deviations. As these data show, cued re- 
call was superior to non-cued recall for a 1 1 nine 
lists, the superiority varying dir ec t ly with list 
length and inversely with the number of words per 
category. The difference between cued and non-cued 
recall thus was smallest for the list in which twelve 
words were organized into three categories, with 
four words per category. In this case, presentation 
of category Barnes ae retrieval cues apparently does 
not help subjects very much since they presumably 
can remember (he category names on their own. 
The largest difference was found for the 4 8 - wo r d 
list In which each >vord belonged to a different cate- 
gory. Presentation of category names as retrieval 
cues In this list facilitated recall considerably: sub- 
jects in the cued recall group recalled over thirty- 
five words on the average, vhlle the subjects in the 
non-cued group recalled less than sixteen words. 

The major Implication of the results of this ex- 
periment is that the subject’s failure to rec all a 
word he was instructed to recall does not necessar- 
ily mean that information about the membership of 
the word In the list Is no more available In the mem- 
ory storage. It Is availab 1 ?, but not accessible un- 
der the typical unalled recall conditions. If the sub- 
ject receives cues aoout the “location” of the rele- 
vant Information In tie storage, he will “find” many 
otherwise Inaccessible words. Thus, intratrlal “for- 
getting*' (Tulving, 1964; of at least some of the Items 
does not reflect the failure of the storage mechanism, 
b4 only the failure of the retrieval mechanism. How 
does the retrieval mechanism operate? 
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TABLE 1 

MEAN NUMBER OF WORDS RECALLED AND THEIR STANDARD DEVIATIONS FOR THE EIGHTEEN 
EXPERIMENTAL CONDITIONS 











Number of Words Per Category 






List 

Length 


Recall 


1 




2 






a 


Conditions 


M 


S. D. 


M 


S. D. 


M 


S. D. 




Cued 


10.70 


1.57 


10.94 


1. 12 


9. 98 


1.55 


12 




Non-cued 


7. 70 


1.61 


8. 13 


2. 03 


9.31 


1.91 




Cued 


21.70 


1. 97 


19.31 


2. 38 


15. 11 


3. 17 


24 




Non-cued 


11. 18 


2.56 


11. 82 


2.54 


13. 38 


3. 08 




Cued 


35.35 


6.42 


35.76 


7.86 


29. 60 


6. 00 


48 




Non-cued 


15. 57 


3. 53 


18.79 


5. 99 


19.33 


5.34 



The Tulvlng and Pearlstone {1966) experiment pro- 
vides some data relevant to this question, Word-re 
call data in an experiment of this type, where words 
are organized into higher-order units by the experi- 
menter - in this case, Into superordinate catego- 
ries - and where this organization is adopted by the 
subject, can be analyzed Into two independent multi- 
plicative components, number of categories recalled 
and number of words recalled per recalled category 
(cL Cohen, 1963, 1966). A category is s a id be 
recalled - to be accessible - il at least one word 
from that category is recalled. Given the number 
of total words recalled and the number of categories 
recalled, the mean number of words recalled within 
recalled categories can be obtained simply by divid- 
ing the former number by the latter. For Instance, 
if the subject recalls the words SUGAR, CLOVES, 
and LAKE, he has recalled two categories - sub - 
stances for flavoring food and geological forma- 
tions - and an average of 1. 5 words pe r category, 
two words from one c a t e go r y , and one from t h e 
other. 

The breakdown of the word-recalldata into these 
two components revealed two Inter e sting facts. 
First, presentation of category names as retrieval 
cues affected only the number of categories recalled, 
In all lists the mean number of words recalled with- 
in a recalled category was the same under the cued 
and non-cued recall conditions. Second, word-re- 
call Increased as a direct function of list length for 
both cued and non-cued recall conditions, but again 
this Increase was attributable primarily to the In- 
crease In the number of recalled categories and not 
lo the Increase tn *he number of words recalled per 
category. For the 24-word and 48-word lists the 
number of words recalled per category was invari- 
ant. 

These data suggest then that recvllof wordsfrom 
accessible categories is independent of the number 



of categories recalled, regardless of whether differ- 
ences in category recall are brought ab">ut through 
presentation of category names as retrievalcuesor 
through increasing the list length and thus the total 
number of categories presented. Retrieval mechan- 
ism seems to operate in some sense independently 
at two levels: at the level of higher-order units of 
organization and at the level of individual items with- 
in these higher-order units. Limitation of recall is 
determined by limitation of retrieval at both levels. 

A further demonstration of the relation between 
number of categories and recall is provided by an- 
other experiment of Ozler's (1965). In this experi- 
ment subjects learned lists of tw e‘n ty -four words 
either under conditions of free recall or under con- 
ditions of alphabetical organization. For different 
groups of subjects the number of unique initial let- 
ters of words in the List was varied. For one group, 
all words began with different letters. For another 
group there were twelve pairsof words (words with- 
in each pair beginning with the same letter); fora 
third group, eight initial letters were u s ed , each 
associated with three different words, and so on, to 
the group in which twelve words began with one let- 
ter and twelve words with another. Thus, the ex- 
periment can be thought of as an analogy to the Tul- 
ving and Tearlstone experiment, with list length 
held constant at twenty-four words, the number of 
categories (initial letters of words) varying over the 
range of two to twenty- four, and the number of 
words per category (words sharingtheinitialletter) 
varying correspondingly over a range of twelve to 
one. Ozier's experiment differed from the Tulvlng 
and Pearlstone experiment In that it was a m u 1 1 1 - 
tidal learning experiment. Each subject was given 
twenty trials of practice on the list to which he had 
been assigned. The order of words was randomized 
on all trials, the words were projected on a screen 
at the rate of one word/ second, and subjects had 95 
seconds for written recall on each trial Under the 
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FIGURE 5, Mean recall on successive b loc k s of 
four trials for list? varying In number of different 
Initial letters and learned under alphabetical organ- 
izing Instructions (A), and for a list learned under 
free-recall Instructions (FR). In the designation^ 
A listSj the first figure refers to the number of dif- 
ferent initial letter s of words, and the second rep- 
resents the number of words beginning with a com- 
mon letter. 




conditions of alphabetical recall, initial le tt e rs of 
the words were given as retrieval cues In the output 
phase. Subjects were premedical students, mostly 
men, with twelve subjects per group. 

On the first trial, there were no systematic dif- 
ferences In the number of words recalled by differ- 
ent groups, and only after the first three trials did 
differences become noticeable. This suggests that 
the presentation rate of 1 second/word was too fast 
for words to be cued with respect to their initial let- 
ters. The learning curves for four alphabetical 
groups and a free-recall group are shown In Figure 
5. The mean number of words recalled Is plotted in 
Figure 5 against five blocks of four trials each on a 
logarithmic scale. These curves show that learning 
varied directly with the number of categories (num- 
ber of unique Initial letters) or Inversely with the 
number of words per category. It Is also Interest- 
ing to note that free recall Is more efficient than al- 
phabetical recall of the list In which there are only 
two categories and twelve words per category. 

The results of the last two experiments suggest 
that under conditions where the subject is provided 
with efficient retrieval cues - or where he can eas- 
ily generate them from his own memory- and where 
the Inter-item associative strength of items within 
a category is minimal, the optimum strategy is to 
organize the Items Into a maximum number of cate- 



gories. On the other hand, under conditions where 
the subject can benefit from organization of individ- 
ual Items into higher-order units only to the extent 
that he himself remembers whatthese higher-order 
units are, the optimum strategy Is to organize Items 
into relatively few categories. It Is most likely, how- 
ever, that when the number of c a t ego r 1 e s Is de- 
creased beyond a critical limit the difficulty of re- 
trieval of items from wllhlna given category will 
outweigh the facilitating effects of smaller number 
of categories, and recall will decrease. In the lim- 
iting case where all Items In a list belong to a single 
category, recall is no better than recall of a list In 
which each item belongs to a different category. 

SUMMARY 



I have argued that understanding of many phenom- 
ena of verbal learning and memory wo u 1 d be en- 
hanced If we adopted the basic orienting attitude that 
a person’s mnemonic performs nee depends to a very 
large extent or the methods that he wittingly or un- 
wittingly uses to organize the material. The Impor- 
tant function of such organization Is to facilitate re- 
trieval of information from the memory storage. 

I considered In some detail the problemof the ef- 
fect of repetition on recall of a set of discrete items. 
Mere mechanical repetition of items does not seem 
to have any noticeable effect on the s ub sequent 
directed memorization of these Items, provided that 
individual Items as such ^re already well known to 
the subject before the experiment. Learning of the 
set, however, can be considerably speeded up If the 
subject uses effective methods of organlzlngthe ma- 
terial. Individual differences among sub J ec ts in 
various learning tasks may reflect primarily their 
knowledge of, and the ability to utilize eff ec t Ive 
strategies and mediationa! devices, and only second- 
arily their innate differences In memorizing ability. 

Different methods of organizing material may 
be incompatible with one another. When the subject 
has been using one method and then Is asked to ap- 
ply some other method to the material he Is memo 
rlzlng, the adjustment to the new method requires 
some time. Interference with overt recall under 
these conditions reflects incompatibility of different 
types of organization, and adds further support to 
the hypothesis that learning is critically dependent 
upon how the material to be remembered Is organ- 
ized. 

It is not necessary to assume that organization 
changes the amount of material that the subject can 
retain, or the amount of Information p o t e n 1 1 a 1 ly 
available in the memory storage. Evidence sug- 
gests that organization only serves to make more 
of the available information accessible. The learn- 
er has always more mnemonic Information avail- 
able, relevant to the successful accomplishment of 
a memory task, than he can ordinarily make acces- 
sible to recall. Accessibility of inf o r mat Ion de- 
pends not only on its availability In the storage, but 
also on retrieval cues. Retrieval cues may be part 
of the environmental conditions prevailing at the 
time of recall, or they may have to be carried in 
memory. Limitation of the retrieval mechanl sm 
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thus seems to be determined by the Lack of accessi- 
bility of efficient retrieval cues, and the functional 
significance of organization Lies In its role of pro- 
viding such retrieval cues. 

Optimum organization depends on the require- 
ments of the recall task. If retrieval cues have to 
be generated from memory, the material Ls best or- 
ganized Into a relatively small number of catego- 
ries - Mandler (1967) suggests that this number 
for common words Is approximately five - If, on the 
other hand they will be available In the perceptual 
environment at the time of recall, the number of 
categories should be as large as possible. Retriev- 
al cues such as category names provide access to 
categories or other kinds of higher-order units of 
material, but once access to such higher-order units 
becomes possible, retrieval of individual elements 
within units is unaffected by the number of higher- 
order units already recalled or yet to be recalled. 

The evidence on which this account has beenbased 
Ls admittedly rather fragmentary, but the initial re- 
sults are quite encouraging. Certain consistencies 
have already become apparent and further work will 
probably clarify those aspects of the conceptual 
framework that are still obscure. 

While all this research that I have discussed was 
not undertaken with a view to solving practical prob 
lems as they occur In learning and remembering 
in real-life educational settings, It does have some 
Implications for these problems. I will review just 
one, fully realizing that It is simply a reiteration of 
what many people have said before. 

The kinds of findings from the s imple experi- 
ments I have described in this paper once more un- 
derscore the need for the examination of methods 
that learners in classrooms use when they acquire 
knowledge and skills. We can never be certain that 
the methods of Learning a person uses are the opti- 
mum ones for the requirements of any given task, 
or that these methods are sufficiently flexible to fit 
all tasks which In fact do require different str at e- 
gles. And at the present time, we probably could 
not even evaluate the appropriateness of different 
approaches to different tasks or different subject 
matters, since we know so little about which meth- 
ods are optimal for which kinds of learners in which 
situations. It seems to me that educators and psy- 
chologists have been more interested In methods of 
teaching than In methods of learning. Teachers are 
frequently taught how to teach, but how often are 
learners given specialized instruction In how to 
learn? A good teacher may be successful because, 
among other things, he organizes the material to be 
learned for the learner, but a good learner is ltkely 
to be more successful because he can organize the 
material on his own even if It ls not optimally struc- 
tured by the external environment. 

To the extent that methods of teaching and meth- 
ods of learning can be separated, it would seem that 
in the final analysis the latter are more Important 
than the former, If for no other reason then at least 
because it might have greater transfer value as far 
as the Individual Learner ls concerned. Even a poor 
learner, one who does not know how to use his Innate 
Intellectual abilities most effectively in learning sit- 



uations, can do better if he has a good teacher to or- 
ganize the material for him, but he cannot always 
expect to have good teachers around him. In many 
situations he has to be his own teacher. Would it 
be too rash to suggest that instruction in how to learn 
and how to remember be as important a part In the 
curriculum of the schools of tomorrow as are the 
three R’s now? 

FOOTNOTE 

1. Research reported in this paper has be e n sup- 
ported by Grant Mo. APT-39 from the Nation- 
al Research Council of Canada, and Giant No. 
GB-3710 from the National Science Foundation. 
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WHEN Professor Klausmelerc hose 
the title for my paper, he asked me %o dea 1 w ith 
three points. First, give an outline of the concep- 
tual framework that 1 am going to use to Indicate de- 
velopmental processes In thought. Sec ond , give 
come account of the research that has been carried 
ou. to test the validity of the general f r a mew or k. 
Third, point out the educational implications of what 
Is dealt with In the first part of the paper. 

The treatment of intellectual processes, Includ- 
ing thought, is rather different In American psychol- 
ogy from that In either Russian or Swiss psychology. 
Only the future can show the extent to which these 
treatments can enrkh one another, or the extent to 
whkh the different approaches say the same thing 
using different terminologies. Individuals wishing 
to know mere of these three approaches would, no 
doubt, be interested In Berlyne’s most revent book 
Structure and Direction in Thinking (1*6S). However, 
1 shall deal with my topic largely from the si a* d • 
point of the Genevan school, for Piaget has great In- 
fluence in British educational circles, although he 
is not quite so influential among British psyc hoi* 
oglsts. 

FIRST 11 MONTHS OF CHILD 8 LIFE 

There Is now much data whkh Indkates that the 
first 11 months or so of a child’s life a r e of great 
Importance from the point of view of the growth of 
thought, Piaget has shown that a baby’s movements 
are not random; indeed, on close inspection they are 
seen to conform to a pattern. This period of devel- 
opment was called by Piaget the period of sensori - 



motor Intelligence, because the schemas, thai is the 
sequence and the structure of the actions slowly 
built up In the mind, are dependent upon the direct 
support of perception and motor activity, from 
12 to IS months of age the cl.U goes through! pe- 
riod of Intense experimentation. He will let an ob- 
ject fall to the floor to see what happens; he w , 1 1 
knock things, shake them, or throw them to se^ if 
they roll. New ways of doing things are discovered 
based on a grasp of rew relationships. For example, 
a child will pull a box toward him In order to obtain 
a toy placed on it, which otherwise would be o u t of 
reach. And between 1ft and 21 months of age, the 
awareness of relationship* Is sufficiently developed 
for the child to be able to invent new means, and to 
be able to foreseewhkh acts will succeed and which 
will not, without putting them to the te st . This in- 
vention comes through a covert process that amounts 
to Internal experimentation. The earlier trial and 
error period is not now so Important, for the child 
can increasingly represent to himself the v a r I ou s 
possible actions a r4 how they must be combined, to 
attain a desired end. The child Is beginning to think, 
for Ms action* are now car tied out In an inward form. 
Some psychologies would call such Internalized ac- 
tio s, Incipient or implicit responses. 

During the first 21 months of so of life, the ordi- 
nary child elaborates the bask schemas of the ob- 
ject, of space, of time, and of causality. For ex* 
ample, the bask schemas in relation to space and 
time are laid down as when the child adjust • his 
reaching actions for near and distant objects, a rd 
when he moves to catch a swinging rattle. 
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In Piagets* s view, the child in adapting himself 
to Ws environment has to assimilate or absorb new 
experiences into his existing schemas. At the same 
time he must accommodate to the environment 
through the modification of existing schemas or the 
bo lid up of new ones. Cognitive adaptation to some 
new situation, and hence the ability to d e al with it 
in thought, involves both these processes. To as* 
simulate the meaning of a new situation the c hild 
must accommodate to It; and in order to accommo* 
date to It, he must be able to assimilate it. Cogni- 
tive growth is thus a step by step process with the 
new always building on the old. But once new ex- 
perience is assimilated, the child's schemas be- 
come more complex, and because of this, moi e com- 
plex accommodations are possible. Moreover, the 
child's schemas do not remain unchanged even in the 
absence of etv iron mental stimulation, for meanings 
are constantly reorganised, and linked with ot her 
meanings. This internal renovation is, In Piaget's 
view, an important source of cognitive development. 
Even so, Intellectual growth is slow. We must also 
note that Piaget's observations lead him to believe 
that it is schemas In the processof organisation that 
children tend to repeat playfully and with seeming 
pleasure. But when such schemas have become or- 
ganlxed, the apparent pleasure disappears and they 
cease to be repeated unless they are combined t o 
form new schemas or serve as a means to some end. 
Flavell (1963) remarks that schemas are structures, 
and one of their Important, built li properties, Is 
that ot repeated assimilation of anything*, el mil able 
in the environment. 

BETWEEN 2 AM) 8 YEARS OF AGE 

Throughout the sensor l- motor period the child Is 
unable to use an Image or word, which could repre- 
sent to him an object or event not actually present. 
For Piaget, the child moves out ot th f s stage into 
what he calls the p re- ope rat tonal stage ot thought 
when the child can differentiate a word from what U 
stands for ; for example, use the sound ' ' d o g ' 
st&nd for, or represent, a dog. When he can do this 
he can represent to himself situations that are no 
longer In actual evidence, and thought Is lifted to an 
entirely new level. Note carefully, however, that 
thought comes before language; the Utter isflttedon 
to thoight that already exists. But once the c hit d 
can use language, thought Is extended over an Un* 
mensely increased rarge. Moreover, he now has a 
more permanent and far more flexible model ot the 
outside world, for he ts no lor*er dependent upon 
immediate perception and motor activity for thought. 
Nevertheless, between 2 and 4 or Syears ot age, 
thinking tends to center on one str thing feature ot 
the a i tuition; It la also Irreversible In that the child 
ts anabte to move back, tn Ms mind, to the starting 
point from which Ms immediate thinking began, the 
child at this stage can only see an event from hit 
own viewpoint; he Is unable to conceive the viewpoint 
ot other children. Yet by I or 4 years ot age the 
child has copied the adult model of language, and at 
this age we are In grave danger of overestimating 
Ms level ot thought from the nature ot Ms speech. 

By about 5 years ot age a change begins to set tr, 
and by 7 to 8 years of age the child's thinking be- 
comes more systematised; that is, Ms thoughts now 
cortform to certain rales and hU thinklrg become# 



what we adults call logical. The sequence and struc- 
ture of actions In the mind, or the schemas, now 
available are now altogether different tn kind. The 
ability to reason and "understand" demands higher 
order schemas which permit a simultaneous grasp 
ot the successive sequences of actions taking place 
in the mind. The ordinary child of 7 to 8 years can, 
as It were, " look down on his schemas" or • r t urn 
round on his schemas. " He Is then aware of the se- 
quences of action In his mind; he can see the part 
played by himself In ordering his experiences; and 
for any action in his mind, he can see that there are 
other actions that give the same result. That Is, he 
sees equivalences. Thus he understands that 4+2* 

3 + 3*7 - lor that all girls plus all boys plus a 1 1 
adulis * all boys plus all adults plus all g 1 r 1 s. In- 
deed, there Is now a new k l nd of coordination of 
schemas, yielding a slmulataneous understanding of 
equivalences for actions within the mind. Thus the 
child cm now measure the same distance In feet and 
Inches arid understand that the d I f f e r e n t figures 
mean the same thing; he can perform subtraction us- 
ing the method of complementary addition; he can 
decompose 42 units in 4 tens and 2 units with under- 
standing. Thinking now conforms to a system, and 
there is learning with a certain amount of understand- 
ing. 

At the level of sensorimotor and pre- operational 
thought there was a great deal ot learning, but little 
or no under stand ( ng the sense that the child 

learned a linear sequence ot action# but was unable 
to elaborate a set ot equivalences. We must not in 
any way belittle learning that takes place before 
thought becomes systematic, for such learning is es- 
sential for the growth ot thougM Itself. I nd e ed tn 
older normal children, and In adults, a gr*at deal 
ot learning Is ot this type. 

Now because the elementary- school child can In- 
creasingly see the part played by himself In order- 
ing Ms experiences, aM because he can Increasing- 
ly coordinate actions in his mind and make them con- 
form to a system, he can build the cone e pt s of a 
class, a series, length, time, and so on. But the 
concepts that he builds are only those that he 
can attain from experience with first hand reality, 
and Ms systematised or logical thought ts r e lated 
only to the world ot perceivable things and events. 
For Piaget, the elementary- school child is at the 
stage of concrete operational thougM and is, for ex* 
ample, able to understand certain aspects of mathe- 
matics. 

END OF ELEMENTARY SCHOOL PERIOD 

Toward the end of the elementary- school period, 
however, children begin to realUe that there ire 
gaps and uncertainties tn their thinking, and that cer- 
tain kinds ot problems cannot be solved by them. As 
the child becomes better at organlilng and struct ur- 
ing problem data with concrete operational methods, 
he becomes more aware that the latter does not yield 
a logically exhaustive solution to hit problem. He 
gropes for new methods ot attack, often in Piaget's 
view, as the adolescent commits Himself toreal life 
situations. 

So from II to 12 years ot ege In able children, 
and from 13 to 14 1 a ordinary pupils, new thinking 
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skills begin to emerge. Due to his continued Inter- 
actions with the cultural milieu, and to the matura- 
tion of the central nervous system, the individual 
can produce more complex expectations when faced 
with certain kinds of situation and data. His logical 
thought is no longer restricted as before, for he can 
Increasingly use statements or propositions relevant 
to objects and their relations. The sequence and 
structure of his mental actions, or his schemas, 
are new In kind. The pupil can now begin to manip- 
ulate statements which refer to classes and relations. 
For example, he can answer the question "If Henry 
Is taller than Mary and shorter than Debbie, who Is 
the tallest?” Or he can argue from the situation in 
front of him that, “Either this must be true <»r that 
must be true, ”or he can see that “X implies Y. M 
The pupil can, for any sequence of ac t lo n s in his 
mind, see a greater range of equivalent actlonsthan 
was the case at elementary-school level. Faced 
with certain situations the child can, at 13 or 14, set 
up an hypothesis and work out what would happen if 
this hypothesis was true. He ia now able to d e a 1 
with the merely possible. The pupil has reached 
what Piaget calls the stage of for mal operational 
thought, and many experiments to illustrate the 
growth of such thought a*e to be f o und In Inhelder 
and Piaget’s (195$) book The Prow t h of Log leal 
Thinking from Childhood to Adolescence (1956). A 
number oi tnese experiments were repeated by Lov- 
ell (1961) and Jackson (1965), and the broad stagea 
In the growth of logical thinking were mainly con- 
firmed although the position is more complicated 
than Inhelder and Piaget suggested. It must be 
stressed, however, that forma* thought Is found in 
all areas of thinking - In history, literature, poli- 
tics - and not Just In science ar.d technology. There 
is much published work to support this statement, 
and if space permitted, t could give you some inter- 
esting illustrations for formal t hlnklng In these 
fields. 

With the onset of formal thought, the pupil is able 
lo elaborate an entirely new kind of concept You 
will remember that In the elementary school the 
child could say how he ordered his experience, for 
he could dissociate the part pUyed by hi maelf in 
classifying his experience from the characteristics 
of that experience. But In adolescence the pupil la 
able to structure and coordinate actions u pon rela- 
tions, which themselves resmt fr om the coordina- 
tion of actions. For example, in the case of beat in 
physks, the Concept depends on the earlier elabor* 
atlon of (he concepts of mass and temperature. The 
Utter are developed at the level of concrete opera- 
tional thought, for each Is a coordination of so me 
Intuitive aspect of reslity, but their product Is not. 
Concepts derived at the level of formal (bought de- 
pend upon the concepts elaborated at the level of 
concrete thought be ir< completely de tac bed from 
their concrete contexts and manipulated as “pure” 
concepts. 

BEHAVIOR THEORY 

Many individuals have been brought up os w h a I 
may be broadly called behavior theory, although nc * 
all Americans think of cognitive growth In behav- 
ioral terms. Some are now talking of “strategies”; 
"structure and “rule”; “programs”; "plans.” 
But for people who have studied behavior theory S 



would like to review a few points that will help them 
grasp how the simplest principles of behaviorism 
look to a Piagetlan. First, if two schemas are fre- 
quently >voked in regular succession they tend to 
form a single, larger, schema comprising the first 
and then the second in that order. The new and 
larger schema is then evoked as a whole. This is 
“conditioning. " The individual action Is, of course, 
the limiting case of a schema. Second, if two or 
more schemas are frequently evoked In Irregular 
succession they, too, tend to form a larger schema 
made up of all the original schemas. This larger 
schema will also be evoked as a whole, although the 
order of the evocation of its parts will depend upon 
the stimulus properties of the situation. Neverthe- 
less, Its value, as a larger schema, lies in the mu- 
tual Inter-facilitation of Its parts. This provides 
the basis for ‘trial and error" behavior thought by 
Thorndike lo be Ihe prototype of all learning. Thlro 
tf a situation evokes a larger “trial and error” sys- 
tem of actions or schema as indicated in my second 
point, and the larger schema Includes a particular 
sub- schema that is particularly appropriate to the 
situation, the effect of accommodation will be to In- 
hibit ano finally eliminate the other sub-sc he m as 
and so strengthen the particular sub- sc hem a (Thorn- 
dike’s Law of Effect). 

The functional principles indicated under my 
three points seem to be common to all schemas and 
show the most elementary forms of coordination of 
schemas. They may account for habit formation, or 
for simple kinds of learning, either In humans or In 
animats, which Involve a linear sequence of actions. 
But we do not Know if they could be made to account 
for understanding, for the capacity lo reason and lo 
understand are not functions or pr ope r t le s of all 
schemas. From time lo time a combination of my 
first two points may well give more "intelligent” 
trial and error behavior from which outsiders or on- 
lookers may Lifer that two separate sequences of ac- 
tions are equivalent to one another. For example, 
a young child, or an older retarded child runs into 
the house by the shortest route whkhlsthe one nor- 
mally used. But If he finds the g a I e locked, he at 
once selects t.ie best alternative. Equivalence is Im- 
plied by the detour behavior, tat It Is no! ex pile it 
in the child’s representation of the situation. 

Within these first and second orde r operational 
schemas, I. e. , schemas that function at Ihe 1 e v e 1 
of concrete and formal operational thought respec- 
tively * the operational structure of systems of 
equivalences form a sub- schema of great generality 
and enter Into all processes©* learning. The acqui- 
sition of such schemas are essential to tear nlng. 
Such schemas do not arise merelyby the pwptl know 
Ing tf his answers are right or wrong; rather they 
seem lo depend upon an active coordination by the 
subject of Ms existing schemas - on h I a ability to 
order Ibese actions simultaneously and to recog - 
nite their systemalk equivalences. Good Caching 
presents situations In whkhauch coordination la 
possible and necessary, and In enough variety for 
the ywap4l to dissociate what Is common, although It 
cannot ensure tlds. It will readily be realised that 
not all learning either In elementary or high school 
is of this form. When a or 15-year-old fa pre- 
sented with a problem fot wM*h he has an adequate 
schema, he will asslmilatel he problem tothe 
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schema by an appropriate method of attack and a r - 
rive at a solution. This Is learning of content. He 
has not acquired a new method of coordination for 
he already had the method. AU the pr oble m did 
was to strengthen the tendency for this schema to 
be evoked when faced with problems of this type. 

The most elementary ways In which schemas can 
be coordinated have Just been indicated and a 1 1 
schemas probably lend themselves to this form of 
coordination. But since these simple methods of 
coordination do not Involve a simultaneous appre- 
hension of successive schemas by higher urde r 
schemas, the connections implied by the coordina- 
tions axe linear. We thus have a linear series of 
actions at the first level of abstraction Involving 
“learning’' but little *mde retarding. Most learning 
In the mentally retarded, and much in ordinary hu- 
mans, Is of this type. 

Let me emphasise that t am well aware that 1 
have not allowed myself to get bogged down over the 
question of whether or not the stages of cognitive 
growth that t have Indicated do actually exist in the 
child's Intellectual growth. Piaget has been mu;h 
criticised over hts stages, some having argued that 
stages do not exist In other aspects of growth. The 
current practice among researchers of s\*)Jectlvety 
deciding whether responses can be fitted Into Pia- 
get’s schema of stages is obviously not suitable for 
assessing the validity of these stages. More objec- 
tive methods are required which would a How the 
data to determine their own patterns and groupings 
and to corrflr m or deny the existence of stages. 

FINDINGS FROM RESEARCH ON PIAGET S IDEAS 

The second port of my paper is about the findings 
from the research that has been carried out to test 
Piaget’s Ideas, t hare heavily condensed the liter- 
ature above stnee the material now at hai4 Is very 
great. Studies hare been made In the realm of the 
general growth of logical thought, Into the child's 
ability to classify and serialise, and Into his notions 
of space, time, causality, snd the like. Whatever 
the future holds regarding the presence of stages, 

It can be said at the (resent that research shows 
that a high proportion of protocols obtained from jxj- 
ptls can be put Into the stages proposed by Piaget, 
or Into intermediate stages. It is true to say that 
the broad picture of the growth cf thought, pre- 
sented by Piaget, has been conf l r med , although 
there are many biota on the canvas, and nt 1 1 m e s 
one must be extremely critical of Ms work. But all 
In all he hat done more than anyone e I a e to threw 
light on the growth of thought processes. Hit ex- 
periments will stand the teat of time, although hit 
theoretical system is certain to undergo changes. 

The great number of studies r e la l in g to the 
growth of concepts shows that It Is between t and I 
years of age ttel the (vp il begins ft elaborate the 
bask concepts of Liathema tics and science for he 
can new dissociate the part pUyed by himself In or- 
dering his experience. If we lake, say, the concept 
of time, H has been amply confirmed that the child 
begins to coordinate instants and Intervals arowd 
6 years of a*e , although be may well have been ow- 
ing time words snd telling the time for son* years 
previously. Lfcewlse experiments relit if g to the 



overall growth cf logical thought have shown the 
same general progression whether in the area of 
science, history or rellg'.ous thinking. The availa- 
ble data again confirms that it Is not until 13 to 14 
in ordinary pupils and 11 to 12 in the very able, that 
formal thought is possible and second order con- 
cepts are elaborated. I must stress, howevir, that 
the »Uges arc not clear cut, and I s ha 11 return to 
this pol^t. Indeed the stages are blurred, so that 
when a pupil Is approaching the stage of concrete or 
formal thought, he is found to be ata more advanced 
stage of thinking in one situation than he Is In an- 
other although both Involve the same oper atlonal 
structure. It is also true that In some experiments 
certain stages appear to b* absent; some responses 
are found that cannot be luted Into Piaget's stages; 
and occasionally a child is found who appears to con- 
serve, say, weight before substance. Chi the other 
hand, there is no research that I know of, that has 
shown that Piaget was wrong concerning the se- 
quence of stages for any one situation for any one 
child. This was clearly seen In s recent study, Just 
completed, where a group of boys wss tested on the 
same experiments each year betwe e n Hand 15 
years of age. 

ft would not be inappropriate If t now gave you a 
couple of examples of protocols obtained In a recent 
study In the growth of logical thought In relation to 
history. It will keep our discussion well and truly 
about children. I take the example from history as 
t cannot then be accused of being interested only in 
mathematics and science. Pupils read a story con- 
cerning William the Conqueror - the last man who 
successfully Invaded England and that was In 10(6. 
With the story still In front of him, each child was 
asked individually, (< Was William the Conqueror a 
cruel man?" This was followed by “W hy do you 
think soT' 

One pupil age 13 years 6 months give areply 
that was clearly at the level ofconcrete thought. 
He said, “Well, William wasn't cruel at the begin- 
ning because he allowed the English lo collect the 
dead bodies. 0 he was really a cruel man he would- 
n’t even have allowed that. Yet later on, after the 
Danes ted left, he’d no need to tske revenge. He 
could have reconquered the North - tried to make 
treaties and things. ” Here the pupil could use the 
information provided, but he was not able to form 
a mature hypothesis from a consideration of all the 
ImpHcallons in a situation. 

Another pupil age 14 years and I months replied 
at ihe level of formal operational thought. “tide- 
penda on what you call cruel. I the definition of 
’cruel’ U lo kill and ravish and burn for any purpose 
whatever, Willi am was cruet On the other hand, 
If one Is prepared (o accept political a e c e a a 1 1 y , 
William's cruelty was justified. Comps red with 
many other feudatories, knights and so on, he was 
essentially s kind man. They ravaged generally for 
their own advantage and without care for the com- 
mon folk of the land. Duke William, If the common 
people went with him, seems to have been prepared 
to protec I the common people from ravages. V, how- 
ever, they went against him, he a e e m a I o have 
treated It aa a deliberate break!?* of faith and acted 
accordingly. So, by the standards of his own day - 
for we really cannot Judge him by our standards * 
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he was probably not a 'cruel man. * ** Thl s pupil 
was clearly able to reason by implication of an ab- 
stract lead. 

One of the consistent findings in our studies at 
Leeds, and It has been supported by the work of 
Jackson (1965) - a student of Dr. Lunzer of Man- 
chester - Is that only a proportion of school educa- 
te retarded pupils reaches the level of concrete 
operational thought even at the age of 15. It has re- 
peatedly been shown to be true in respect of mathe- 
matics and science; while recently we have shown 
that the growth of English morphology In such chip 
dren, even at 15, is loss advanced than that of nor- 
mal children of 4 and 5 years of age if we acc e pt 
Berko's (105t) data as representative of American 
children. Our findings, which will be published, 
were predicted from our knowledge of the thinking 
of this type of child in other areas. The learning 
problems of school educablc retarded children, and 
of the least able left in elementary and high school, 
stem from the fact that their schemas permit only 
a linear series of actions below, or Just at, the lev- 
el of concrete operational thought. They learn, but 
they do not "understand. M Tran&fercertainly takes 
place In these pupils as It did In Harlow's apes, but 
only when the schemas Involved are less complex 
than those required at the level of concrete opera* 
tlonal thought. 

One great Issue that research hasc le a r ly indi- 
cated is mat problems that appear to have the same 
operational structure are not all solvable at the 
same lime. Much research shows that both concrete 
and f ormal operational thought is, at first, a task 
specific within limits, and that thlnklnglsnot organ- 
ized to the ex’ent that Piaget's theory would indicate. 
Dodwell (1960, 1061) showed that there was only a 
moderate correlation between tests which, In Pia- 
get's view, all Involved the same level of thinking 
and which all Involved Integral aspects of the number 
concepts. Later Dodwell (1962) pointed out that 
while the concepts of class and number develop with- 
in the same age range, there was no clear indication 
that they both arose together or that one was elabo- 
rated before the other. Likewise we at Leeds have 
found, as did Dodwell (1965), I hat a pupil could be 
at different stages of thought In three tests dealing 
with the concept of axes of reference. Indeed, Pia- 
get (I960) himself has now admitted that operations 
are only gradually applied to larger and larger nu- 
merical sets, while he has always made It clear that 
It takes a child, on the average, two years to gen- 
eralise concrete operations involved in appreciating 
conservation of quantity before they c a n be applied 
to conservation of weight, although from the point of 
view of cognitive structure the operations a r e the 
same. Even when the concept involved remains pre- 
cisely the same, the quality of the child's thinking 
will vary according to the apparatusused (cf. Lovell 
and Slater, 1960). 

It would, of course, be unfair to the Genevan 
workerL if one failed to emphaslte that they have 
made some provision foe these eventualities. InheM- 
er and Piaget (1951) pointed out that concrete opera- 
tions consist of the direct organization of I m me 4 late- 
ly given data and they cannot be general! ted to all 
situations at one*. For example, l engt h Is con- 
ceived before weight This, In the view of InheMer 



and Piaget, Is because It is more dllflcult to serial- 
ire, equalize, etc., objects whose properties are 
less easy to dissociate from one's actions, e.g. , 
weight, than to apply concrete operations to proper- 
ties that can be rendered more objective, e. g. , 
length. Piaget (1956) also speaks of the notion of 
"horizontal differentials. M This suggests that the 
same or similar concepts when derived from differ- 
ent materials or stations, developin staggered se- 
quence rather than simultaneously. But this notion 
does not (It well Into his general thvory. 

At the level of formal thought we find much Ihe 
same. In a study recently completed, In which chil- 
dren were questioned individually, we have found 
that the schema of proportion Is not available in 
problems Involving money, speeds, areas, series, 
etc., at the same time. Mathematical c one e pt s 
seem often to be available at first In specific situa- 
tions, even when they depend on second order oper- 
ational schemas. Lack of specific experience, In- 
formation, vocabulary, expectancyor individual dif- 
ferences In intellectual functioning w h Ic h are un- 
known, most probably all play ssme part. 

A number of studies have been undertaken, based 
on a neo- behavior 1st approach, to see if Intensive 
periods of specific training lasting a few weeks, can 
6peed up the growth of understanding of particular 
Issu'c, for example, the conservation of number or 
welg T t oulcome of these studies has been 
largely t. conclusive, Piaget’s view (R I ppl e and 
Rockcastle, 1964), which was expressed In 1 9 64, 
Is that the child may learn something of the s l tu a- 
tion, but the training will have no effect on his gen • 
eral level of understanding tor the >peclflc attack 
U too trivial. The modification of ft child's mental 
structures In Paiget’s view, necessitates afar 
wider, more lasting, and more radical a ppr o ac h 
which Involves many of Its child's activities. 



THE WORK OF SMEDSLVND 

In concluding this section of my paper twill re- 
view a few details of a recently published work of 
Smedslund (1964). It was a very Important study as 
It Is cxtrememly relevant to some of the points that 
I have raised in this section of my paper. The spe- 
cL'/c purpose of the study was to Investigate the in- 
tern lattons e 4 the spec If ic itqilsiUon of ability for 
concrete reasoning ocing different Items. He care- 
fully laid down a number c4 methodological rules 
which were apptied to the construction of items In 
order to maximize their diagnostic validity. The 
Items Included class Inclusion, reversal of spatial 
order, conservation of discontinuous quantities, con- 
servation of length, transitivity of len gt h . etc.,- 
nine Items In all. Many of the Hems have sub- items. 
All the tests were given individually to 160 children 
age 4 years J months to 11 years 4 months, evenly 
distributed over age and sex. 

the upshot of his findings was that aider the giv- 
en v ©editions of the experiment, one c oa Id predict 
with a fairly high degree of confidence from the suc- 
cess or (allure on one sub- item to success or fail 
ure on another sub-item; that Is, Intra-Item relia- 
bility was high. On the other hand, the picture was 
different between He ms , for the Inter -item 
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relationships were far lower. The difficulty of the 
Items varied L'om 122 passes to 77 passes. When 
children who had passed or failed all the ltemswere 
excluded, only 18 percent of the remaining subjects 
conformed with the hypothesis that the Hems are ac- 
quired lr the order of their difficulty as measured 
by the total number of subjects passed. 

Smedslurd polrts out, in retrospect, what he con- 
siders to be a marked weakness in his study. He 
proposes that when investigating a concrete reason- 
ing task we need to make a clear distinct ion be tween 
percept - a process depending upon the momentary 
stimulus input; goal object - that which the subject 
Is told to attain; and Inference pattern which is 
formed by the set of premises and the co nc lu s i on. 
Tor example, the stimulus situation as apprehended 
by the Subject are the percepts; quantity and length 
are goal objects; and conservation and transitivity 
are inference patterns. Smedslund thinks that since 
all three factors influence the solution rateofltem'y, 
the effect of a single factor can only be studied with 
the others held constant. The author is of the opin- 
ion that other things being equ^l, conservation pre- 
cedes transitivity, but he feels that only In relation 
to one goal cbject, and one narrow perceptual c on- 
text, will it ie possible to determine whether or not 
conservation, transitivity, serlation, associativity, 
commentaUvlty, addilion/subtractkm, multiplica- 
tion, etc. , are acquired In rigid predictable se- 
quences. Here, indeed, is t f1e!d for research. 

IMPLICATIONS 

tn this section of my paper, t want to discuss rr.y 
interpretation of the educational Implications of Pu- 
get’s work and to suggest on r or hro line s of re- 
search. To be helpful thave listed a number of points. 

1. While experience is always necessary for men- 
tal growth, Piaget is ctearlhat mere submission to 
external experience is not trifle lent to make a child 
restructure his own thinking. Rather the child has 
to be active. He has to act on material things and 
become aware of the significance of his actions. 

2. His observations lei him to believe that it Is 
schemas that are in the process of organisation that 
children lend to repeat pUyfuily and with seeming 
pleasure. Further, when such schemas ha ve be- 
come organised, the apparent pleasure disappears 
and the schemas cease to be repeated unless (hey 
are combined to form new schemas or se rve as a 
means to some end. I earning then seems to s t a r I 
from the child, from the schemas that he sir eady 
has available. Actions on his part, that Is, explor- 
ing, discovering, using new ways to solve old prob- 
lems, all have on intrinsic Interest for the young, 
and are self- extending. Naturally the t eve I of In- 
trinsic motivation varies from child lo child, due, 
perhaps, to the level of activity In certain areas of 
the central nervous system. Hut when the schemas 
required for the so tot km to some problem ore not 
too far removed in complexity from those available 
to the child, (he Inadequacy of existing schemas will 
force him to accommodate to the conditions of the 
problem. Hence the child restructures Ms own 
schemas toward greater cognitive adaptation to his 
environment Not only does the child solve the prob- 
lem, but he extends his capacity for further learn- 
ing . The implication of Piaget’s findings Is that we 



need to begin to stimulate the Intellectual growth of 
the child In the early weeks of life. Thechlld needs 
to encounter a variety of changesof sensory experi- 
ence in respect of sight, sound, touch, and move- 
ment. He needs an opportunity to see and grasp a 
variety of objects, and later, suitable toys that in- 
volve him In a greater range of actions; opportuni- 
ties for physical movement and experimentation; 
and novelty. We must always bear In m I nd that 
there must not be too g r e a t a gap between the 
schemas available to the child and Ihose demanded 
oy the situation. Yet In spite of the he 1 p given by 
Piaget In assessing a child’s level of thinking, what 
is Involved in producing the correct amount of gap 
between the schemas available to the child and those 
demanded by the situation remains vague. This Is 
where the Intuitive skill of the teacher Is called for. 
It Is his task to arrange, or find In the environment, 
problems which call for'.h the schemas of the child 
In new and novel ways. 

3. While language acts as a vehicle for thought 
and enables It to be carried Immensely further, 
language Is fitted into the thinking that originates In 
the first two years of life. ff thought and language 
are to keep In step with one another as Ihe child con- 
tinuously models his language on that of adults, the 
child must be active in building his thought proc- 
esses. If this Is not the case, It Is more likely that 
the child's verbalisations will lead adulls lo th I nk 
that he understands more than he actually does. 
There is a grave danger of this happening between 
about 2 and S years of age since the child has copied 
the adult model of language yet he remains at the 
pee-operatlonal level of thought. One fundamental 
lesson for parent and teacher from Piaget Is that 
while language is Important, mere verb all sal Ion and 
verbal knowledge are of little value In themselves. 

4. Piaget (1926) Indicated that social influences 
play a role In helping a child to move from cognitive 
egocentrism to systematic thought. Mere experi- 
ence may have no effect on the available schemas, 
or an attempt may be made to distort the experience 
so thal It could be assimilated. But social Interac- 
tion with the peer group forces the child to re- 
examine Ms own thinking, so that he can satisfy his 
need to share the thoughts of others and Ms need to 
communicate with them. Argument with the pe er 
group forces the child to reason with himself. Like- 
wise, dialogue and discussion with par ents and 
teachers, the answering of questions, etc. .contrib- 
ute to the growth of concrete operational thought 

5. Piaget’s views clearly support what is broad- 
ly caJ 1 a discovery approach to learning w Ith a 
Jodktc is e of expo sll km atthe elementary school 
level yd in high school more use can be made cf 
exposition since the child's ability to appreciate t\? 
form of an argument Improves, and be is able to 
elaborate concepts not themselves derivable from 
first hand experience. The Geneva school argues 
that the onset of the stage of fu mal thought is rel- 
ative to the culture pattern. Beyond the age of 1 1 
years or so, due u> ^hystologicsi factors, (his lev- 
el cf thinking iua/ be a product of the progressive 
acceleration of Individual development under the In- 
fluence of education and culture. The 1) year-old 
ts not only dissatisfied with the gaps and uncertain- 
ties resulting from concrete ope ration* I thought, 
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but he Is beginning to think beyond the present. 
This thinking ahead Is likely to be determined by the 
experiences received at home, at sc hoo l , a nd at 
work; his social attitudes; the climate of opinion and 
expectancy In the community, and the concepts that 
are frequently made use of In the society. In com- 
mitting himself to the future, the adolescent begins 
to build theories. 

All high school pupils thus need the opportunities 
to discuss with adults and teachers, and a mo ng 
themselves, viewpoints and theories relating to var- 
ied problems; the viewpoints and theories some- 
times being In direct conflict with one another. They 
also need the chance to see, at first hand, the kinds 
of employment lhat will be available to t h e m , and 
be In k position to think of, a^ discuss, their fu- 
ture roles as workers and clfirt.'S. They thereby 
get greater opportunities to commit themselves to 
possibilities. The grci’er the need to question and 
find out, to struggle for solutions to problems, and 
to commit oneself to possibilities, the greater 
seems the likelihood of formal thought developing. 

It may be that the culture pattern rather than the 
school plays the greater rote In thegrowthofformal 
thought although we do not know if this is so In fact. 
Peluffo's (19ft4) study, which compared children 
born In Sardinia but who had been InCenoa for vary- 
ing lengths of time, with children born and bred in 
Genoa, gives some indication of the likely effects of 
the culture patterr on the onset of formal thought. 

6. In the upper- element ary classes and in high 
school, extrinsic motivation begins to influence the 
pupil. For example, he may become aware of what 
his parents or society expect of him; or he may fear 
failure or punishment If he does not work hard. One 
must not belittle inis kind of motivation for it often 
stimulates the child to Learn and to work as hard as 
he can at the level of thinking at w h 1 c h he is. But 
there is no evidence that it can, In Itself, change the 
quality of the pupil's thought. Extrinsic motivation 
may well hold a pupil to a Issk, and in virtue of the 
prolonged child-task Interaction enable him lo re- 
structure his own schemas. Thus external Irtflu- 
ences which are at work over a number of y e a r s , 
as, for example, parental encouragement, ran play 
an important but Indirect part In Intellectual growth. 

CONCUMO* 

In conclusion, 1 would like to suggest areas In 
whkh we need research: 

I. What are the long-term effects of very early 
stimulation of the culturally deprived and of certain 
types of school educable retarded children? U such 
Is commenced during PUget's sensor I -molor stage 
of development, hem do the long-term outcomes 
compare with those outcomes when the enriched en- 
vironment Is delayed until 3 and S years of age? The 
recently reported long-term study of Steals (1M3) 

In Amerka suggests that very early all mu tali c*i 
may be of great importance. And what is the most 
suitable stlmulatk* to provide at ft, ft, IS months? 

1 What are the long-term effects of an education 
based, as it were, on Piagetlan Ideas, par tkularly 
when they employ materials and situations o* Intr In- 
•k Interest to the child, from K through gr ade ft? 



Of course there will be some exposition, as there 
will be an Increased proportion of time spent on ex- 
position In the upper classes of l he elementary 
school and In high school. What are the long-term 
effects of such methods over, say, 15 to 18 years? 

Is there any difference between such children and 
those brought upon other approaches at the second, 
fourth, eighth, and twelfth grades? 

3. What is the effect of the emotional life on cog- 
nitive development? This is an Important, although 
complex, question lhat cannot be brushed aside. In 
the 3 to 5 year period especially, fantasy - which I 
define as emotion clothed with images - Is playing 
a role In the growth of thought. We Ignore this at 
our peril. If In real life a child can dramatise his 
fantasy, he may free himself from the dominance 
of fantasy, and thought processes may devdop 
smoothly . When the 2- io 5-yeax*old Is presented 
with a story or situation which he only partly under- 
stands, he brings to It his experiences and h!s fan- 
tasies to fill in gaps and structure, say, the story. 
Each young child will have something of his own in 
the Interpretation of the stoiy, for Information can- 
not yet be classified systematically and objectively. 
In the fairy tale particularly - which again is only 
half understood - the child's feelings of fear, anger, 
love, etc. , which already exist, are perceived 
by him In the story. The story acts as a mirror and 
he Is helped In recognising toe parts In himself In 
Ihe "Good Prince" or "Bad Dragon. "The "mirror* 
like properties" of fairy stories, and the fact that 
he can structure it with his own experience and fan- 
tasy, perhaps explains Us abiding value. Similarly 
the child deals with his fantasy in p&lntingor model- 
ing. At ft to ? years of age fantasy Is still at work, 
but »he child is In better control. He tr ay now ac- 
cept a story tha’ he could not tolerate at ft. Ismno 
clinician In the accepted sense of the t e r m, but I 
have enough experience with young children to know 
that Ihe fantasy life Is playlr^ a role In the growth 
of thought processes although we have tittle evidence 
In a scientific sense on this point. What Is the ef- 
fect of kindergarten and school activities and whkh 
are likely to help the child to control his fantasy? 
What Is the effect of using materials likely to have 
personal slgntfkance for him? The mat he mat kl an - 
logiclan may be forgiven (or Ignoring this when he 
is trying to teach kindergarten children something 
about sets. The psychologist and educator should 
realite that here is an Important field about which 
we know little. 



ft. Whal is the effect of the culture pattern and 
subculture patterns on the growth of human though 
processes? We know something of the relatioo be- 
tween socioeconomic groupings and attainment but 
far less about such groupings and thought. Evidence 
from Hong Kong via Goodnow (1962), and from the 
Tlv tribe of Nigeria via Prke-Wllliams (1061, iftftl), 
suggests that culture pattern may not have as seri- 
ous effect on the growth of concrete operational 
Ihought as on formal thought, especially til he ma- 
terials used are well knows to the testers. Never- 
theless there is some delay ai the level of concrete 
reasoning due to culture pattern as the work of Pe- 
hrffo (lftftft) In luly, and Aimy (1 • ft ft) in America. 
YOiat are the characterises of the sub-cult a r es 
tlut have the greatest down pulling effect? 
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5. We need to know why at schema, say. that of 
proportion cannot be applied to a w Id e variety of 
situations at the same time How Important Is fa- 
miliarity with the problem, lack of specific experi- 
ence in that area, and expectations basedon previ- 
ous experience? 

6. We noed a very great deal of Information re- 
garding the growth of more advanced concepts In 
mathematics and science, e. g. ."function” and "en- 
tropy. M 

These questions that f have raised are broad 
ones, but ones of great Importance. They a r e of 
significance to mankind, not to Just the Americans 
or the British. 
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THE LAST decade hu teen ft skxrp 
increase In the volume of researchou creativity rnd 
creative think In* with ft major focuaon isolatingthe 
basic processes of creative thought (Medntek, 1 96^; 
Mendelsohn and Griswold, 1964) and on identifying 
the unique characteristics of creative persons (Mac- 
Kinnon, IMS; Barron, 1964; Crutchfield, 1963), De- 
spite such unprecedented interest in creativity, un- 
til quite recently there has been relatively little re- 
search on the general problem of nurturing and pro- 
moting creative thinking, especially in the c tan- 
room setting. However, due partly to increased 
public awareness of the need to husband our intel- 
lectual resources, this Important top<c Is beginning 
to receive the attention and research support it de- 
serves. 

The purpose of this paper fs to describe part of 
the research program at Berkeley for developing 
curriculum programs aimed at promoting the gen- 
eral level of creative thinking among elementary- 
school children and to consider some of the pedagog- 
ical Implications of such research, especially re- 
garding the value, feasibility, and fustlfkatlon of 
teaching for creative functioning. For a survey of 
ofher current research tn this area representing 
differing theoretical and methodological approaches, 
see Myers and Torrance (1964), Others (19*1), 
Fames (196$), Such man (1961). ant' Upton and mp- 
soa (1961). 

By way of Introduction , it should be noted that 
most of the current attempts to develop such teach* 
tng materials, including that of the Berkeley group, 
share two fundamental assumptions: (l)that all 



children, regardless of age or initial intellectual 
level, fall far short of resitting their potential for 
crealire thought, and (2) that these individuals can 
be taught to make fuller and more appropriate use 
of their capacities by means of systematic and 
direct training of certain cognitive skills. 



As for a definition of a creative child On a real 
sense the ultimate criterion by which the success 
of a teaching program must be Judged), It is gener- 
ally agreed that he is intellectually curious and ex- 
ploratory, taking an active part in manipulating and 
reconstructing his environment. To paraphrase a 
mmber of current definitions: 

The creative child prefers to explore the un- 
known, rather than lo conserre the already 
known: be prefers explaint, *g f ac t s tn new 
ways, rather than continuing to rely on tra- 
ditional well-established explanations; he in- 
dulges In adventuresome thinking and raises 
questions, rather than being c onte nt with 
things a* they are. 



With these preliminary comments setting the 
stage, we turn next to more pointed observations 
abort the nature of creative thinking and bow best 
to foster ft - observations which to a large degree 
hare determined kh* specific form and character of 
the research cf the Berkeley group. As a first step, 
we will identify and discuss several widely- he Id mis- 
conceptions abort creative functioning and Its facil- 
itation. 
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MISCONCEPTIONS CONCERNING THE N/.TUFE 
OF CREATIVE THINKING 

Perhaps the ir.ost commonly held belle! concern- 
ing creative functioning is that the child will become 
creative ol his own accord - by drawing on some 
heretofore latent potential - if only he can be placed 
in a stimulating yet permissive and nurturing en- 
vironment. The erroneousness of this view is due 
not so much to a misreading of the nature o! man as 
It Is to an oversimplification of the means by which 
his latent capacities axe to be realized. More spe- 
cifically, an environment which Is at once per m Is- 
flve and stimulating undoubtedly plays an Important 
role In c stablhihlng the conditions necessary for 
creative output , but this Is only part of the story. 
Tn order to take full advantage of an unresirlctlve at- 
K'osphere, the child must first come to understand 
what constitutes creative ideas In thriven situation 
and how he can achieve such Ideas for himself. In 
short, he must learn how to think c r er t ive iy. in 
this connection, a growing body of observational and 
empirical evidence (Hammer, 1961; Holt, 1964; 
Peel, I Pf'O; Torrance, 196$) indicates t ha t most 
school children are Inadequately pr ‘pared for crea- 
tive thinking. Corroborative data gathered by the 
Berkeley group at the f Ut.i-grade and sixth* +rade 
leve’s reveal a conspicuous Inability among students 
to think of any Ideas, much less c le ve r or novel 
ones. Moreover, there is little understanding ofthe 
nature of originality and virtually no sense of plan- 
fulness which Is necessary for prolonged effective 
work on a creative task. Not surprisingly then, one 
finds that the responses of most children tochalleng- 
Ing tasks, even In a permissive environment, are 
by and large pedestrian and generally lacking In 
creative merit. 

In order to think creatively the child must have 
at his dlspossl a repertoire df c re it We thinking 
skills. Tontine slew: the Ability to recognize 
gaps in existing Information; a facility at formulat- 
ing relevant questions, and a sensitivity to the de- 
mands of the task so one can adequately Judge the 
suitability of proposed Ideas. The epttomy of crea- 
tive thought is a sense of "disciplined abandonment. ” 
An array of cognitive skills Such ss those Just men- 
tioned constitutes the "discipline" component which 
must be present in concert with an accepting nurtur- 
ing environment before the child can take full advan- 
tage of such freedom and "abandon" himself to the 
tssk at hand. Thus, seen tn this perspective, the 
Job cf fostering creative thinking Is a more compli- 
cated undertaking than suspected by m a ny. It Is 
more than merely provtdlr* a permissive atmos- 
phere for the release of creative potential ; It is 
more like teaching the child how to make use of his 
freedom to create. 

ff one must teach chlldrei to think c r eatively. 
then what kinds of pedagogical strategies would seem 
most appropriate? There are, no doubt, a number of 
reasonable answers to this question. For example, 
one approach * the traditional one - ta to teach I n 
such a manner that the child will come to act crea- 
tively la a number of different subject-matter d 1 a* 
clplines. Another contrastlrg, yet complementary 
possibility is to teach for a number of cognitive 
skills fundamental to all creative thlnklrgt and then 
show the student how such generalized skills can be 



applied In specific subject matter areas. This lat- 
ter strategy carries with it the impllcatlonof devel- 
oping curriculum materials whose subject-matter 
Is the creative thought process itself. As we shall 
see presently. It Is this approach which Is being ex- 
plored by the Berkeley group. 

Although there Is considerable latitude with re- 
spect to the variety of reasonable a ppr o ac h es for 
promoting creative thinking tn the classroom, there 
are limits. Some limits can be established based 
on our growing Knowledge ol the dynamics ofthe cre- 
ative process. For example, it has been we II es- 
tablished that creative thinking Is largely dependent 
on cognitive operations and dispositions of a non* 
logical chtrader. Yet despite this, the notion as 
well as the practice pers'sts of teaching for logic 
and for critical thinking as means for promoting 
creathe functioning. As we shall see shortly, cre- 
ative thinking, whether it be In science or \n the hu- 
manities, involves a good deal more than rational 
and critical analysis, and to teach only fer t he s e 
functions to the exclusion of more Imaglnal specu- 
lative processes Is to fall short of fostering c r e a- 
llvo thought. 

ft has been further argued that teaching ior sci- 
entific methods of thinking will establish a respect 
for the lawfulness and the simplicity of nature Itself. 
Although the child may Indeed infer from such exer- 
c ises that natur e Is orderly and lawful, such a* in;* 
der st aiding may curiously enough act to fetUj ci e* 
ative thought. More spectf kaltyjascurreTuTjTtt^m, 
elementary school science, the humanities, and <hc- 
social sciences as well, do not always reflect the 
way scientific investigation andc re at Ire scholarship 
actually happen. Creative contributions to any field 
of knowledge are made by wrestling with ambiguous 
conflicting facts and data wUh the o v e r a 1 1 aim of 
bringing conceptual order out cf chaos. However, 
as represented In many current textbooks, the 
drama of the pursuit cf such order and understand- 
ing is replaced by an c /erslmplifled, tailored, and 
predigested view of a discipline, emphasizing what 
Is already known and rtresslng the all-encompass- 
ing explanatory power cf presently accepted theories 
or laws. Such a simple, clear-cut pr esentat Ion 
which smooths over complexity and controversy Is 
designed primarily to male for more efficient learn* 
ing and retention, rather than to focus on the prob- 
lem cf how the chlM himself can learn to manipulate 
a given set of facts, lo draw his own cot>c Ins Ions, 
or Indeed to discover new facts, whkh Is after all, 
one of the primary functions of the creative Innova* 
tor. There Is little question that such textbook pre- 
sentations wilt make for the most rapid, untroubled 
assimilation and mastery of the mater lal, but H 
should not be assumed that the approach which 
makes for the most efficient learning will also be 
most effective In fostering creative and productive 
thinking. 

Moreover, in the way most Abject matter haa 
been traditionally taught, the studeMtt r are ly al- 
lowed to prac'ke on problems whkh require Innova- 
tive modes of thought for their toll t ton. Conse- 
quently, he has no direct opportunity to learn what 
constitutes creative ways to manipulate data, nor 
to develop an IntsIHve sense for designing research, 
nor to ask questions whkh favor serendipity xxd 
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maximize the chance for new Insights. In short, 
the child does not acquire the cognitive f kills which 
would be most helpful In preparing him for future 
productivity. 

A specific case In point Illustrating the lack of 
emphasis on thlrklrg crcatlvety about facts and In- 
formation Is the set of so-called rr dlscusslon ques- 
tions’ 1 found at the end of many textbook chapters. 
As commonly used, these questions are not partic- 
ularly helpful In promoting creative patterns of 
thought. Often the student is merely asked to think 
about these questions with little or no subsequent 
follow-up discussion of the adequacyofhls answers. 
With minimal dialogue between the student and the 
teaching authority, the child rarely gets any syste- 
matic feedback as lo nhaf counts as merely an ade- 
quate answer as oppesed to an Ingenious, novel one. 
Even In those cases whire the teacher finds time lo 
comment on the quality of the pupil's ess ays, the 
feedback Is Inevitably delayed, thus reducing the ef- 
fectiveness of the exercise. Because the child typ- 
ically operates from question to question In what Is 
essentially a “cognitive vacuum 1 ’ with little oppor- 
tunity to protlt from hts past efforts, he Is unable 
to develop any Internal t'andards of excellence 
against which he can evaluate subsequent ideas. In 
effect this means he is unable to modify his efforts 
In the direction of more creative and Imaginative 
output 

Another feature of such discussion questions* 
their placement at the end of the chapter - strength- 
ens the Impression that these exercises art simply 
an appendage, added to the text as an afterthough; 
rather than forming a central part of the learning 
experience itself. Moreover* their placement oc- 
curs at the psychologically Inappropriate moment 
for stimulating productive ideas. By the end of the 
chapter much of the Intellectual tension and drams 
build up as part of the content presentation will have 
dissipated, maMng It difficult to engage further the 
child’s Interest In contrast, the placement of dis- 
cussion questions should be coordinated with the pre- 
sentation of the content itself, ciplUHtlrg on the 
student's Immediate curiosity and momentarily 
aroused Interest. 

RECOMMENDATIONS FOR A CURRICULUM OF 
CREATIVE THIN KINO 

Recognizing some of these pedagogical deficien- 
cies, what can be recommended with regard to a 
curriculum for creative thought? The first recom* 
mend at ion Is that such a cwrrkwtim feature re- 
peated opportunities for the child to practice wreet- 
Ung with complex challenging tasks of the kind that 
might, In a more complex form, engage the efforts 
of creative adults. Of course, such problems (which 
we shall call “creative -tasks -In- miniature”) must 
be scaled down and simplified in many respects * In 
particular, redoclrg their dependence on technical 
or specific knowledge, Nevertheless, even with var- 
ious modifications c4 this type such tasks could stilt 
retain the bask elements of any Intellectually crea- 
tive undertaking. A second recommendation is that 
certain broad guides and strati g tes for creative 
thinking be Introduced as the child works on t h e s e 
tasks. Such guides would act as points of reference 
around which the child could organize his work and 



would Impart an atmosphere of planfulness to the 
process of problem solution. 

Next, what can be said more specifically about 
the nature of these “creative-tasks-in miniature 11 - 
their particular content and the composition of the 
accompanying rules and strategies for productive 
thought? It Is sobering to realize that the creative 
Innovators of the year 2000 (only $2 years hence) 
are to be found in the elementary schools of today. 
As these individuals stand on the threshold of the 
twenty-first cenlury, they will be confronted by sci- 
entific revelations and soc lal Issues literally un- 
dreamt of today as well as a large share of old prob- 
lems left unsolved by previous generations. To 
meet these challenges the Innovator of to mo r r ow 
must create new social systems, new scientific tech- 
niques, tools, and theoretical s t r uc tu res . To 
accomplish this, he cannot rely on presently fash- 
ionable views as to what constitutes fruitful scholar- 
ship or good scientific method, nor can we afford to 
Instill In him a blind devotion to currently fertile 
theories, since much of this theoretical apparatus 
is already approaching obsolescence. Here then ts 
a compelling argument for the necessity of teaching 
broad strategies for creative thought and of encour- 
aging cognitive flexibility and Intellectual curiosity, 
rather than merely teaching for what we presently 
take to be true or useful. 

What kinds of tasks could children practice on 
now to prepare them for their roles as the Innova- 
tors of the future? Two kinds are suggested: the 
hypothetical problem and the e nduring problem. The 
Former type minim lies reliance on present facts 
and theories in obtaining a solution, while the latter 
type focuses on the deathless Issues of human af- 
fairs which are certain to be the subject of creative 
reinterpretation and re-evaluation in any future age. 

Typkally In the case of the hypothetic al problem 
certain artificial conditions are postulated whkh do 
not correspond to present realities, and the individ- 
ual is called on to operate wlthtn these Internally 
consistent but artlffcM systems. One problem of 
this type, whkh Itself has become popular as a meas- 
ure of creativity, Is the consequence test : given 
certain conditions, such as a world 5T whkh time 
runs backwards, what art all the consequences? 
Such problems demand cognitive flexibility, Imagi- 
nation, and the ability to adopt as temporarily real 
a set of foreign and uriamlllar assumptions. 

At Berkeley we are now drawing up pi ins for an 
experimental teaching apparatus whkh simulates a 
visit to a straiye planet The student Is put In 
charge of fl>e first exploratory expedition. Hts Job, 
a highly creative and demanding one. Is to come to 
understand and to explain the w e 1 1 e r ofstrange 
events whkh he w>H encounter In this alien, unfa- 
miliar world where (he usual physkal, biological, 
and social laws are suspended or greatly modified. 
Here the child is literally confronted wiOiahypo- 
thetkal world whkh, although it Is ordered and In- 
ternally consistent, operates In ways that fun 
counter to hU previous experience. Re must sus- 
pend his present expectancies about the world as be 
knows It long enough to create new explanations lor 
strange and perplexing phenomena. Thus, by per- 
mitting the child to dealwltnhypothetka! tasks whkh 
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call for the creation of new systems of Ideas, Inde- 
pendent o. present facts and assumptions, he can 
hedge against the time when these facts will outlive 
their usefulness and wilt no longer serve as a basis 
for productive thought. 

Granting the largely unknown course of future 
events, there are nevertheless certain enduring 
problems of man and society which are constantly 
reasserting themselves and no doubt will engage the 
attention of future creative thinkers. The young stu- 
dent of today can best be prepared to cope with such 
Issues in adulthood by being presented now with re- 
peated opportunities to deal with enduring themes 
and quandrles: to search for new Implications and 
to re-phrase them in contemporary terms. Many 
of die most suitable teaching examples are found in 
literature, such as the Greek myth of Sisyphus, deal- 
ing with man’s reluctance to accept his fate ; the 
tragedy of Frankenstein, reflecting the consequences 
of man's age-old dre«tm of creating a more perfect 
being is his own Image; or the mythical Icarus, per- 
sonifying man's unflagging zeal to explore nature 
regardless of the consequences. Ofcourse, it Is 
understood that such issues cast in the form of teach- 
ing examples would have tobegreatly simpl Ified 
and made appropriate to a child's level of under- 
standing. Notice, however, that such modifications 
are made easier by the fact that the traditional ve- 
hicles for the dramatization of these issues are 
themselves reasonably constant - the novel, the 
play, and the poem - prov Lding already familiar 
media through which children can express their 
ideas. In this connection, we shall presently de- 
scribe a “creative-task- in-miniature’ 1 In which the 
student creates a play dealing with yet another time- 
less and recurring theme - th* plight of the wrong- 
fully accused. 

Finally, what arc the sources on which one can 
draw in formulating a set of broad cognitive skills 
and strategies which conld be taught now to prepare 
children for future productivity? Information con- 
cerning such generalized cognitive strategies can be 
gleaned not only from laboratory research d e a 1- 
Ing with complex problem solving and thinking but 
from anecdotal and life-history accounts of highly 
creative Individuals as well. In the first instance 
there Is a steadily accumulating body of knowledge 
from the psychological laboratory concerning the 
kinds of fax tors, both facultative and inhibitory, 
which influence the course and quality of productive 
thought. One widely documented example is the del- 
eterious effect of rigid mental set on effective prob- 
lem solving (Luchins, 1942). Here, because the in- 
dividual Initially formulates or perceives a task In 
a narrow and Inherently biasing way, he is effectively 
sealed off from attaining a solution. A number of ap- 
propriate thinking strategies Incorporating these and 
other research findings can be formulated. For ex- 
ample, with reference to the present example of 
mental set, the student can be taught to view a prob- 
lem broadly, to re-phrase questions In new ways, 
and to resist Jumping to premature conclusions. 

The other 3ource of cognitive strategies comes 
from anecdotal descriptions of creative individuals 
at work (Ghiselln, 1852; Koestler, 1964). A number 
of insights Into the fundamental nature of creative 
thought have grown out of such observations as well 



as the discovery of Important phenomena associated 
with creativity, such as incubationand Intuition. As 
an example, the famous and widely cited se If - r e- 
ports of Poincare, the French mathematician, have 
served to focus attentionon the conceptually fertile 
notion of creativity as basically a process of recom- 
bining ideas In new and novel patterns, And of most 
relevance to our immediate concern, such observa- 
tions have led to the elucidation of a number of spe- 
cific problem-solving strategies, among them the 
technique of Identifying the essential elements of a 
problem situation and deliberately juxtaposing them 
in various ways (Campbell, 1960). 

By combining the experimental laboratory ap- 
proach and Its virtues of empirical validation with 
the rich and broadly inclusive self-reports of the 
highly creative thinker, one can formulate a set of 
rules and strategies which are pervasive enough to 
apply to a variety of creative tasks, yet simple 
enough to be readily understood by elementary- 
school children. 



In summary of the first section of this paper It 
has been argued that before the student can take full 
advantage of a permissive stimulating atmosphere 
he must be taught how to think creatively. In devel- 
oping a teaching program for creative thought the 
single most Important pedagogical Issue Is the long- 
term social and personal usefulness of what i s 
taught. It has been suggested that one reasonable 
teaching strategy. In light of this consideration, Is 
to strengthen those cognitive skills basic to all cre- 
ative thought in the context of complex yet meaning- 
ful problems which reflect the principal steps In the 
creative act. These observations, taken as a whole, 
have formed the broad guidelines for the research 
carried out by the Berkeley group ove r the past 
several years. 

THE PRESENT RESEARCH 

As a first step It was decided to develop a set of 
prototype instructional materials dealing with only 
one aspect of productive thought- creative problem- 
solving. If the particular teaching approach showed 
promise, then other programs w ou Id be designed 
focusing oo yet other domains of creative thought 
such as creative innovation and creative expression . 

After several years of intensive effort Involving 
numerous pilot tryouts, successive revisions, and 
seveval full- scale experimental studies, the Gen- 
er al Problem Solving Program was developed (Cov- 
ington, Crutchfield, and Davies, 1966). The Gen- 
eral Problem Solving Program (GPSF) consists of 
a s e r le s of sixteen ,f c r e atlv e -tasks -In* minia- 
ture" designed for the fifth-grade and sixth*grade 
levels. These problem episodes act as a vehicle by 
which the student practices a number of broad rales 
and strategies concerned with various facets of ef- 
fective problem solving, such as stat’ng the prob- 
lem in an open and unbiased fashion, reformulating 
the problem In terms of familiar me ta phor s and 
analogies, or developing a systematic plan for ge n- 
eratlng ideas. 

Each lesson presents a mysterious occurrence 
or unexpllcable happening which the student tries 
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to explain, such as the puzzling behavior of a group 
of aquanauts during a deep-sea dive. This general 
themo - the mysterious occurrence - was chosen 
because Li encompasses in a natural and uncontrived 
manner many of the fundamental aspects of the prob- 
lem-solving process. In addition, such a theme Is 
neutral with respect to orthodox curriculum mate- 
rials. This makes for a broader transfer of what 
is taught than might otherwise be the ca se if the 
principles and concepts had been associated prima- 
rily with a specific content area. Finally, children 
exhibit a keen Interest in working on problem situa- 
tions featuring a mystery-detection theme. 

Each lesson is presented in booklet form and is 
cast In a self- instructional Lnear format. (For a 
theoretical discussion of the potential uses of pro- 
grammed instruction for fostering h Ighe r - order 
thought processes, see Crutchfield and Covington, 
1965. ) Briefly, the child works through the lesson 
in a step-by-step sequence by him s e If and at his 
own pace. As the problem unfolds page-by-page, 
with the advent of new fact', and clues, the student 
is called on to reformuli;' i the problem In his own 
words, to list questions he considers crucial to the 
solution or to devise a plan of action which he l n- 
tends to follow. The student receives immediate 
guidance In his efforts on successive pages of the 
booklet. This guidance typically takes the form of 
presenting a range of ideas, questions or courses 
of action which the student might have thought of in 
the given situation. Here the emphasis is on en- 
couraging appropr late diversity In the student’s 
thoughts by showing him within wide limits what 
constitutes valuable ideas, crucial questions and 
fruitful ways to formulate problems. 

The GPSP Is also designed to promote beneficial 
attitudes toward productive thinking. One of the 
basic strategies is to Increase the child's experi- 
ence In coping successfully with thought problems. 
Each problem episode is sequenced so that as the 
student works through the booklet he is exposed pro- 
gressively to more clues and hints. Thus, each 
chHd, independent of his initial capacities or per- 
sonal reservations about thinking, will at some point 
come to discover the solution for himself. In addi- 
tion there Is a systematic attempt to i o s t e r , by 
means of appropriate teaching examples, a number 
of attitudes which favor effective problem solving, 
such as open-mindedness, persistence, and suspen- 
sion of premature judgment. 

A story- line is maintained throughout the GPSP 
to supply a sense of continuity, and perhaps most 
importantly, to provide the reader with a setof iden- 
tification models. The story concerns t w o school 
children, Jim and Lila (brother and sister), whose 
extra-curricular pastime is the exploration of mys- 
terious situations which arise in and around their 
hometown. Jim and Lila are assisted- and when 
the occasion demands, assiduously directed step- 
by-step - through these adventures by their uncle. 
The uncle In addition to being a high- school science 
teacher also “moonlights” as a detective. 

The identification- model technique Is intended to 
introduce the reader grrdually to the difficult and 
often frustrating process of becoming a more effec- 
tive thinker. For example, the roles of Jim and 



Lila reflect the vicissitudes associated withallcom- 
plex problem solving - the long discouraging peri- 
ods of intense effort with little apparent progress, 
the inevitable setbacks, and finally, the Intellectual 
elation of discovering a solution. Through Jim and 
Lila the reader can experience all this vicariously 
without being plunged immediately into the situation. 
After the first few lessons, however, the reader is 
gradually drawn into the various problem- solvingac- 
tivities by being requested to think of and to record 
h s own Ideas in concert with the efforts of Jim and 
Lila - first the student generating his own ideas or 
questions, then Jim and Lila responding with theirs. 
The feedback examples provided for the reader are 
presented as Jim's and Lila’s ideas. 

Against this backdrop of transitory d ay-to-d ay 
successes and failures, a long-range change takes 
place in Jim and Lila. They are depicted as over- 
coming initial handicaps of reticence, apathy, and 
negativism toward thinking until ultimately, but not 
without an occasional setback, theybecome reason- 
ably comfortable with their own thought processes, 
much more enthusiastic about tackling problem sit- 
uations, and more confident in their own abilities to 
cope with them. It is hoped that this subtle but per- 
ceptible change in Jim and Lila will foster In the 
reader a sense of his own progressive improvement. 
At the same time It is Intended that as many readers 
as possible will finally come to surpass Jim and 
Lila bi problem-solving proficiency and wllloutgrow 
any fxlier dependence on them as a source of Ideas 
and inspiration. 

The Inclusion of the uncle provides Jim and Lila, 
and presumably the reader as well, w l th a benevo- 
lent authority figure and t idant who not only nur- 
tures and encourages the nascent attempts of these 
tyro-thlnkers buc who also shows them how to think 
for themselves by means of appropriate rules and 
strategies. Additionally, the uncle stands as a val- 
ued model personifying an enthusiasm for intellec- 
tual exploration. 

Each lesson Is presented in an illustrated format. 
Such a dominantly visual presentation not o n ly In- 
creases the student’s Interest in the materials, but 
makes it easier for him to follow the necessarily 
complicated dialogue and thought sequences of the 
story characters. The lessons contain an average 
of 40 pages and are designed to be presented at the 
rate of one lesson per day. The average time taken 
to complete a lesson is approximately 35 minutes. 

Several separate studies (summarized in Coving- 
ton and Crutchfield, 1965) have been carried out us- 
ing various preliminary editions of the GPSP which 
to date have involved a total of some 481 fifth-grade 
and sixth-grade schooi children from ihe San Fran- 
cisco Bay Area, of whom 267 were given the train- 
ing materials d the remaining 214 were used as 
controls. The basic design of these stud ie s is es- 
sentially the same. All students are first adminis- 
tered an extensive pretest battery (six hours In 
length in the latest study) which consists of a number 
of tests of creative thinking (Torrance, 1965), tests 
of problem-solving ability (Covington, 1966c), in- 
ve ;ories designed to measure the child's attitudes 
toward problem solving and thinking (Olton, et. aL , 
1967), and various tests of school achievement and 
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scholastic ablHt>. These data are used as a basis 
for the Initial matching of the classrooms. Individ- 
ual classrooms are matched in pairs; on e class- 
room from the pair Is then assigned at r a ndo rn to 
the instructed condition and the other to a co nt r o 1 
condition. In each of the various studies to date, 
the instructed groups have always been administered 
the GPSP. In contras* a number of different c on - 
trol conditions have been used to test various hy- 
potheses about the nature of the training effect. The 
typical case, however, and the one on which the 
present analysis Is based, calls for the administra- 
tion of a similar but shorter set of self- instruction- 
al materials whose content is urn elated to problem 
solving. The purpose of the control program is to 
insure a sense of involvement and participation on 
the part of the control children and to make certain 
that they are well acquainted with the self-instruc- 
tional format. Following the training pe r iod all 
classes are administered a posttest battery which 
includes a repeat of the attitude Inventories and the 
tests of problem-solving ability along with parallel 
forms of the tests of creative thinking. 

Several examples will suffice to illustrate the 
general types of tests Included In the pretest and 
posttest batteries - their content, style and degree 
of similarity to the training material. One type re- 
flects the more traditional tests of problem solving. 
In these instances, because of a large number of re- 
strictions placed on the task, there is only a limited 
set of answers or principal solutions which will sat- 
isfy the problem In its entirety. Here an emphasis 
is placed both on convergent and d'vergent thinking. 
The student is called on to diverge in his search for 
appropriate ideas - opening up a ho s t of possibili- 
ties - but at the same time to converge , focusing on 
the few most suitable ideas. A representative sam- 
ple is the X-ray problem (a modification of the clas- 
sicproblem u sed by Karl Duncker). The child 
is required to Invent a method to kill a tumor deep 
inside a body by using an X-ray but without harming 
the surrounding healthy tissue. The primary con- 
straint Is that if the X-ray is too strong it will kill 
both the healthy tissue and th.*? tumor. If, on the 
other hand, the X-ray is made too weak, It will rot 
harm the good tissue, but neither will it kill the tu- 
mor. Incidentally, this problem In addition to pos- 
sessing a high degree of curriculum relevance is 
quite unlike anything encountered in the train! ng 
lessons in terms of content or theme. 

The other main type of problem included In the 
criterion batteries Is the Minnesota Tests of Crea- 
tive Thinking (Torrance, 1965). Such problems are 
quite open-ended with few constraints. This allows 
for a number of solution-ideas, no one of which can 
be judged as the most suitable. One example featur- 
ing a product- improvement theme requires thechlld 
to think of all the ingenious clever ways to make a 
toy dog more fun to play with. 

As to the results: in general, the outcomes of the 
various studies employing the GPSP have been high- 
ly consistent. The performance of the instructed 
children is markedly superior to that of the control 
children both on the tests of problem-solving ability 
and on the tests of creative thinking. (For adetailed 
report of findings as well as a discussion of scoring 
procedures, se*> GUon, et. el., 1057.) 



In order to gain a clearer picture of the over-all 
magnitude of this training effect, consider several 
performance indices such as total Ideas generated, 
total quality of Ideas, mean quality per idea and the 
incidence of principal solutions. Composite scores 
for each of these indices are computed for every 
student by summing over his performance on a num- 
ber of problem-solving tests In the posttest battery. 
In the same manner a similar set of composite 
scores is obtained f or the t e s t s of creative think- 
ing. On comparing the mean values for the instruc- 
ted and control groups on any of these composite in- 
dices it Is found that the instructed groups are In- 
variably superior. In most cases the magnitude of 
these differences is absolutely large and beyond mere 
statistical significance. This Is Illustrated by the 
fact that when comparing frequency dlstributlonsfor 
each composite Index, the fiftieth percentile of the 
Instructed groups typically falls around the seventy- 
fifth percentile for the control groups. 



Another way to gauge the d e g r e e of educational 
significance of a tiainlng effect is to compare the 
level of performance of instructed and control chil- 
dren of differing .Q levels. In this connection it has 
been found (Covington, 1965; Covington, 1966b) that 
the mean performance of Instructed children with 
IQ’s below 99 (mean IQ = 91) Is on a pa r w 1th the 
mean performance of control children whose IQ’s 
fall between 100 and 115 (mean IQ = 107), Thl3 in- 
dicates that the dminlstratlon of the GPSP makes 
for a substantial boost in the performance of low IQ 
children over a wide variety of test problems, many 
of which are curriculum relevant. 

To determine how long these training effects per- 
sist, a follow-up test battery was given five months 
after the administration of the posttest in two differ- 
ent studies. These follow-ups included approxi- 
mately 80 percent of the fifth- grade children from 
the original samples who by this time were In sixth- 
grade classrooms with new teachers. Wnerever 
possible every precaution was taken to insure that 
the students did not recognize the tests as a part of 
the earlier work. For example, the children re- 
corded thetr ideas on regular school paper, rather 
than in a standard booklet of the kind used in the 
original study. All the tests were administered by 
the teacher herself, and whenever possible were in- 
troduced as part of the regular classroom work. 

In the case of tests of problem-solving ability, 
the instructed children continued to surpass their 
control counterparts on the various performance in- 
dices, and although the margin of differences had di- 
minished somewhat as compared to the magnitude of 
effects found at the time of the original posttest, the 
difference were nevertheless found to be statist. - 
cally significant. The picture Is not as consistent 
for the tests of creative thinking. In one sample 
with atotalof I08children, the instructed group vas 
superior to the control group, whereas In another 
slightly larger sample these differences washed out. 
It appears that after a five-month Interval the train- 
ing effects are at best marginal In the case of crea- 
tive thinking tests. This Is not surprising w he n it 
Is realized that as a group these tests represent a 
type of problem not directly trained for in the GPSP. 
Consequently they would be more likely to reflect a 
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greater diminution in training effect than would the 
tests of problem-solving ability which are more di- 
rectly amenable to the kinds of strategies taught for 
originally. 

ISSUES OF VALUE AND 
JUSTIFICATION 

One of the most fundamental questions raised by 
the present research is whether programs designed 
to promote creative thinking are actually needed, 
seen in the perspective of a child’s total educational 
career. No matttr how beneficial a given teaching 
program may be. It is likely that untutored children 
(the so-called controls) will sooner or later catch 
up, simply through the normal process of intellec- 
tual maturation and accumulating experience. In the 
present data the sizable reduction in the magnitude 
of the training effect five months after the adminis- 
tration of the GPSP supports this contention. Of 
course, it can be argued that more permanent-* and 
In this sense more meaningful - changes will occur 
only on an accumulating basts, and that what Is 
needed is a program covering a whole school year 
or even longer, consisting of Interlocking, coordi- 
nated curriculum units which build on one another. 

It remains a moot point, without empirical support, 
yet It would seem likely that a long-range program 
of increasing scope and complexity designed to stim- 
ulate intellectual growth would allow the instructed 
child not only to maintain a performance superior- 
ity, but actually to Increase that margin as the pro- 
gram proceeds. While It is true that the trained 
and the untrained student alike enjoy a natural ex- 
pansion of intellectual capacities, there is grave 
doubt that the untutored children would ever make 
use of their burgeoning capabilities to the same ex- 
tent as would children who received systematic long- 
term training. And, as we have seen, since most 
elementary- school children make scant use of their 
present capacities for creative thought, there is lit- 
tle reason to believe that these same children at a 
later age would spontaneously draw on their capac- 
ities to any greater degree. 

A related point concerns the developmental 
changes in attitudes and values which favor the ex- 
ercise of creative thought. While it is quite 1 e a r 
that sheer proficiency in various cognitive skills 
such as question asking or idea generation Is a func- 
tion of age, there is as yet no evidence that the rel- 
evant attitudes and values increase as the child 
grows older. Thus, even though untutored children 
may In time overtake the trained children in terms 
of sheer proficiency, they may be markedly defi- 
cient in the very attitudlnaJ. dispositions necessary 
to put such skills to meaningful use. In this connec- 
tion, creativity training can be designed to provide 
the student with experiences he is u n like lv to re- 
ceive anywhere else - the challenge of working on 
a complex but meaningful problem or the sense of 
satisfaction at discovering a solution - experiences 
which may affect the child’s emerging set of values 
and attitudes regarding creating functioning. Such 
experiences, If they occur at decisive points in the 
individual’s development, especially In childhood, 
maybe sufficient to bring him permanently past a 
critical threshold for actualization of his creallve 
potential. As a matter of fact, we may find in the 
last analysis that the key to the unlocking of creative 
potential is to strengthen sets of attitudes and values 



which predispose the student to undertake creative 
tasks In the first place, rather than to start by In- 
creasing his sheer competence for performance by 
means of "skill training. *’ 

FUTURE RESEARCH PUNS 

Research plans for the Immediate future take two 
main directions. The first of these Involves further 
development and expansion of the GPSP. In one In- 
stance a set of supplementary exercises Is being de- 
veloped to provide additional practice on the various 
skills and strategies taught in the lessons. These 
exercises are primarily for remedial purposes and 
can be used when needed, depending on the r ate of 
progress of the individual learner. Another project 
concerns the development of a set of "currlculum- 
llnk-units , 99 that is, lessons designed to illustrate 
how the student can apply the skills and strategies 
taught for in the GPSP to his actual school work In 
science and tho social studies. 

The other main direction of research Involves 
the development of new self- Instructional teaching 
units which introduce the student to domains of cre- 
ative thinking other than problem solving . One ob- 
viously important area ts that of creative understand - 
ing. Here, ty pically, one is conf ronted with a series 
of complex events or occurrences which in the ini 
tial phases of investigation often appear to be unre- 
lated. The task is one of discovering meaningful re- 
lationships between such events and In some In- 
stances of predicting how these events would co- 
vary under various conditions. In the case of prob - 
lem solving defined in a more traditional fense,the 
search is typically of a more limited nature - that 
of discovering a single workable solution-Jdeawhlch 
satisfies a certain requirement, but often without 
the necessity of understanding why It woiks. Such 
a pragmatic emphasis tends to make for closure 
once a solution is obtained. On the other hand, cre- 
ative understandhig not only encompasses the dis- 
covery of workable ideas, but more often involves 
an ongoing procedure of checking and re-checking 
the validity of the proposed solutions against an ac- 
cumulating set of facts and Information. 

Another area of creative output, perhaps the one 
most generally assumed when reference is made to 
creativity, is that of creative Innovation . Here the 
individual invents or creates new problems, new 
systems of thought, or new products which did not 
exist previously. One example of a proto type training 
unit presently being developed Involves the creation 
of a school play. The story- line concerns some 
malicious damage done to a barn owned by a local 
farmer and the farmer’s un war rented accusation 
that a certain boy is responsible. The boy, who is 
innocent, Is able to convince hie classmates of this 
fact, bvt is unable to prove It to a degree that satis- 
fies the farmer and the rest of the adult community. 
Understandably the children react with indignation, 
but at the same time they realize their es 8 e nt lal 
helplessness at being unable to d e f e n d adequately 
their interests in an fdult world. While some of the 
children make plans to track down the real culprit, 
others decide to express the group seeling of ineffec- 
tuality and frustration by means of a play. Paren- 
thetically, such a plot can be used to Illustrate tiuit 
there are other alternatives to the expression of 
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one's emotions besides direct aggression and that 
Intense feelings can serve as a basis for the devel- 
opment of useful and satisfying products, The par- 
ticular theme -the plight of thewrongfully accused- 
was chosen because it sounds a note of high drama 
and arouses immediate interest and sympathy In 
children who typically have akeenly developed sense 
of fair play. Moreover it represents - even when 
placed in such a simplified context - one of the en- 
during Issues of man and society which demands 
new solutions from each succeeding generation* 

The same general pedagogical devices are usod 
here as in the GPSP. The student is led to develop 
the play in a step-by-step sequence, while thinking 
of his own ideas and being provided in turn with ap- 
propriate feedback and redirection of his efforts. 
In the early lessons the child works through se- 
quences dealing with the creation of t he basic plot. 
The student is encouraged with the assistance of 
identification models In the story to generate 
ideas which seize on the malicious incident as a 
point of departure from which to explore t h e more 
general implications of being wrongfully accused. 
This is In contrast to the more pedestrian and com- 
mon-place approaches of simply dramatizing the 
boy's Innocence or holding the farmer up to ridicule. 
Basic to the success of th!^ teaching sequence Is the 
introduction of metaphorical and analogical modes 
of thinking. Once such concepts are grasped by the 
student he Is able to go far beyond a strictly literal 
interpretation of a situation and can generate a vir- 
tually limitless set of implications. 

After the outlines of a clever Insightful plot are 
secured, the student explores a number of detailed 
matters, all of which are important tothef Inal prod- 
uct. In one lesson he creates ideas for the most ef- 
fective scenery and staging, given a limited amount 
of material to work with; in another he is called on 
to create segments of the dialogue. The last lesson 
in the series simulates the public reaction to the 
play which represents a final confirmation of all the 
preceding activities. Various members of the audi- 
ence including the farmer and the parents of the ac- 
cused boy react to the play. There Is general rec- 
ognition that It was worthwhile in its own right as 
well as being helpful in c le ar ing up a community 
misunderstanding. 

FINAL PARADOXES 
AND DILEMMAS 

Inherent In any attempt to teachfor creative func- 
tioning are a number of dilemmas and paradoxes 
which give rise to both me theflo logical and theoreti- 
cal difficulties. In conclusion we will consider <^ne 
recurring dilemma, mi^ecauseit Is necessarily 
representative or even the most fundamental, but 
rather because It Indicates s> raethlngof the extra- 
ordinary challenges encountered in developing teach- 
ing materials for fostering complex cognitive proc- 
esses. Basic to the act of teaching is a gu Idanc e 
function. To a greater or lesser d egr e e the stu- 
dent's behavior is necessarily guided, shaped, and 
redirected by a teaching authority. The student 
never has complete freedom. He Is exposed only to 
certain learning experiences, In certain teacher-de- 
termined sequences. He is e nc our aged to talk abc>!t 
these experiences In only certain ways, using pre- 
arranged kinds cf terminology. if we teach for 



creative functioning, then the child will inevitably 
be subject to some form of guidance. To the extent 
that an educaticnai theory stresses the “discipline 
component" of creative thought, any forthcoming 
curricula will be more or less restrictive and pre- 
determined. How then can we reconcile these pro- 
crustean-like features of teaching with the fact that 
in the last analysis creativity is primarily charac- 
terized by Lmaginal freedom and a spontaneous indi- 
vidualization of thought? Perhaps the answer, most 
simply put, Is to teach for structured spontaneity . 
One technique adopted for this purpose and em- 
ployed in our current work is to give the student di- 
rect practice in discriminating among ideas which 
are both unique and appropriate to a given task and 
ideas which are merely bizzare. In such a fashion 
the student learns to limit the reachescf his sponta- 
neity. Another technique which requires a relative- 
ly long term training program Involves comprehen- 
sive guidance in the early phases of learning. But, 
as the child becomes more proficient in the various 
skills and strategies, the rigid guidance of the pro- 
gram is gradually reduced. In this manner the stu- 
dent comes ultimately to rely on his own resources 
and initiative with only occasional redirection from 
the program. As the student becomes mo r e self- 
sufficient he can experience yet another dimension 
ol intellectual Independence - that of deter min ing for 
himself which of several creative tasks he will work 
on from among a number of alternatives. For ex- 
ample, in the case of the creative drama unit just 
described, the child could be given the option of 
either writing dialogue or of developing the scenery 
and staging, once he had completed the introductory 
units. 

Ail the foregoing Implies a complex catering to 
the individual differences of the learner; first, an in- 
tensive close-knit and personalized guidance of the 
child in the early phases of learning and later, en- 
couragement of self-direction and self-determina- 
tion. In both cases the training environment must 
be capable of selecting, soquencingand coordinating 
a gr^at many combinations of material. This Im- 
mediately suggests computer-assisted teaching. The 
self- instructional format of the current and proposed 
teaching programs Is admirably suited to a computer- 
assisted operation. Indeed, another facet of t. i 
work of the Berkeley group is that of ad a p t i n g the 
GPSP for a computer presentation, thus by- passing 
the cumbersome booklet format with Ltslimitedfeed- 
back capabilities. With computer as si s t anc e the 
child can be guided through a much more individual- 
ized sequence of learning, dictated by his initial lev- 
el of competency, his particular cognitive style, and 
his individual rate of progress. Conceptually, it may 
appear that computers and programmed Instruct Lon 
are antithetical, perhaps even perversely so, to the 
task of promoting creative thinking. However, such 
an unlikely juxtaposition points to the kinds of imag- 
inative responses which .he educational community 
must make to the challenge of educating individuals 
In an increasingly complex and demanding world. 

FOOTNOTE 

1. The research r eporte Jin this pap? r was supported 
by a grant from the Carnegie C\ ‘poratlon of 
New York under the direction of the author 
and Dr. Richard S. Crutchfield. This paper 
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covers research conducted through l*k Sum- 
maries of our more recent research activities 
can be found in Olton, et. al. , (1967) and Olton 
and Crutchfield, In press. 
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A COLLEAGUE of mine r e c e n tly 
spent a semester in seventh grade (Smith and Geof- 
frey, 1965). Ln a school servlngaculturally disad- 
vantaged neighborhood, he tried to at te nd class 
every day and played the role of a non participant ob- 
server. His account of this experience is very dis- 
couraging to a person who is primarily interested 
in human motivation. Take, for instance, one sim- 
ple incident: 

Harry had been over at the confectioner' 
across the street, and had come out with the 
rest of the boys on Tuesday, when a fight be- 
gan on the playground. There had been con- 
siderable excitement and Mr. Inman (the 
principal) was trying to calm everyone down. 
Harry had left his pen over in the confection- 
ery and wanted to go b r u across the street 
to get it. Mr. Inman told him to wait for 
a few minutes, A little while later, he asked 
the question again and was told to wait. Then, 
or on the third time he had asked and was 
turned down and told not to bother Mr. Inman, 
Harry walked off and made a muttered and in- 
decent comment. This was the end of it for 
him. 

This commonplace incident in itself is minor and 
doesn’t carry the Impact of the whole report where 
such Incidents cumulate. It can be taken, however, 
as illustrative. The utter futility of the situation is 
striking. This and other incidents make it clear 
that the children feel powerless to control their own 
destinies. As a result of their futile attempts to as- 
sert their initiative in Inappropriate ways, they cre- 



ate an environment where even the teachers and ad- 
ministrators are forced to act ways that are not 
of their choosing. The result is a constant struggle 
between pupils and the school staff to obtain the up- 
per hand. Teacher? search for ways to enhance 
their power to control the behavior of pupils, and 
the children use every means at their command to 
subvert the authority of the school, the last- resort 
being hostility through passive dependency. Both 
parties to the situation are ultimately pawns in the 
hands of the powers beyond their control. 

Two more or less disconnected things stand out 
for me in approaching the problem of motivation in 
schoolchildren. First, the tangled web of influ- 
ences will not yield to any miraculous new Insights 
or techniques. The Gordian k n o t is real and w i 11 
only yield very slowly to modest and patient efforts 
to unravel one or two threads at a time. In this age 
of crash programs, imminent breakthroughs, etc. , 
motivation is an important concept to consider, but 
v e must not expect it to solve all problems. 

The second thing that strikes me is that one of 
4 he loose strands that may have potential for unrav- 
eling both practical and theoretical aspects of the 
knot Is the notion of powerlessness, which is, after 
all, a motivational concept. 

What I have to report then, is no breakthrough, 
but rather a modest beginning that attempts to d is- 
cover whether certain aspects of motivation can be 
measured in a population of culturally disadvantaged 
children, and whether some of the motivational con- 
cepts akin to power lessness can be used. 



J 



32 RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 



Actually we will discuss three different but re- 
lated things. Firet, I will present some uot lo n s 
about powerlessness and what l will call v .he “Ori- 
gin-Pawn” variable and discuss very briefly some 
relevant laboratory studies that we have completed. 
Second, I will shift to a discussion of achii vement 
motivation and some of the conceptual and scaling 
difficulties that it presents. This is necessary in 
order to introduce a third section dealing w^th data 
on the achievement motive in c ultu r al ly «l Is ad- 
vantaged children. These three sections may seem 
a bit disjointed. What holds them together Is the 
relationship between the concepts to be presented in 
faction one and the achievement motive. At the 
present stage of the research there is little to re- 
port on these concepts except laboratory studies, 
but we do have evidence on achievement motivation 
from culturally disadvantaged children. Asa result, 
I have more or less arbitrarily put the two together 
with a discussion of some theoretical problems with 
the measurement of achievement motivation. 

POWERLESSNESS AND THE ORIGIN-PAWN 
VARIABLE 

In the anecdote related above, Harry was frus- 
trated by his powerlessness to influence an impor- 
tant aspect of his life vls-a-vls a sc hoo 1 official. 
He was a pawn to forces beyond hi s control. In 
much of his experience in life, and especially In 
school, he is, in fact, and is expected to be, a pawn. 
Learning seems to demand that he react to outside 
influences In the school, and oi.e way to insure that 
he will react in the proper manner is to reduce his 
freedom to a minimum, to force him to study, to 
press him into the mold expected by the school, 
Techniques designed to do this demand thatthe teach- 
er and the school have most of the power and that 
power be taken away from the student. 

Motivationally there is something wrong with this 
picture. The student, caught up in a power field, 
will do everything he can do to break out of it, and 
when he leaves school, he will be out of It. Is the 
goal of teaching to produce certain responses in the 
jehool that are almost certain to be a function of the 
specific power situation and, therefore, not trans- 
ferred to non- school situations? Or is there a 
broader goal? 

We would like to distinguish between the driven 
or power- Induced school behavior, and behavior 
motivated from within the student that will carry 
over to extra-school behavior. The belief that the 
latter Is possible reduces to analve assumption that 
we all make In our everyday interaction. The as- 
sumption is that each individual has some autonomy 
and exercises it by originating his own behavior. 
Let me use the one word “Origin” to connote a per- 
son who Is perceived to be originating his own be- 
havior. A person Is not always an “Origin. ” Often 
we perceive his behavior as stemming from a force 
field so that he is coerced to behave in a certain way 
by an external source. In such cases, I shall refer 
to him as a “Pawn” or as acting like a “Pawn. ” It 
should be clear that pawn-type behavior Is Induced 
by lack of power on the part of the pawn. Origin 
type behavior implies a feeling of power, although 
It U not entirely complementary In this respect to 
pawn- type behavior. Pawn behavior implies power- 



lessness, but origin behavior Implies freeclomof 
choice, not necessarily the ability to wield power 
over others. 

Having sketched the “Origin-Pawn” dimension, 
let us note that it is essentially a phenomenological 
given In the perception of behavior. As such, it may 
be a myth or a mental way station, to use Skinner’s 
railroading metaphor. To extend the metaphor, we 
might say that the main line of behaviorism runs no- 
where near this way station, and efficient operation 
of the line would suggest that the station should be 
dropped. In fact, scientific psychology has been at 
pains to discredit the assumption that a human being 
can be the ultimate origin of some of Ms behavior. 

Behaviorism, suffering under the strong Influence 
of operationism and physicalism, has done Its best 
to reduce the concept of motivation in psychology to 
something of the order of “the study of the causes 
of behavior. ” The trouble with this approach is 
that trying to elucidate the concept of motivation by 
means of the concept of cause is like tryingtounder- 
stand the behavior of a human being using concepts 
found to be Inadequate to explain the behavior of bil- 
liard balls. The precept that all sc le nt if ic state- 
ments must be based ultimately on statements about 
physical operations has great merit, but the hidden 
implication that explanations of physical motion (In- 
cluding behavior) are reducible to the laws of me- 
chanics has seriously retarded the development of 
theories of human motivation. 

Stripped of Its Mdden assumptions, the neo-be- 
havior lstic approach to motivation as the cause of 
behavior is unacceptable to anyone and has never 
been seriously held by anyone. It assumes that the 
human being is like a billiard ball and his behavior, 
like that of the bail, is entirely the result of exter- 
nal sources forcing him to behave. Another object 
hits him and steers him In a certain direction - an 
explanation that would account for certain trlvialbe- 
haviors on the football field perhaps - or an exter- 
nal noxious stimulus repels him like one negative 
charge repels another, or an internal co nd it Ion 
(e.g. , drive- stimulus) produced by external circum- 
stances (e.g. , food deprivation) drives htmlnacer- 
tain direction. 

Confronted with the phenomena of motivated be- 
havior which in this framework appears akin to a 
sudden inexplicable movement of a billiard ball rest- 
ing alone on a perfectly level table, psychology has 
Ingeniously devised many schemes to explain this 
untoward behavior In terms of some mechanisms 
Involving a causal chain of events and ultimately re- 
ducing to some undetected source of physical energy 
closely connected with, or actually residing In, an 
impelling stimulus (e.g., the cue ball). The cue 
ball, or impelling stimulus, has been v ar lou sly 
described as a need or drive (Hull, 1943), a drive- 
stimulus (later Hull and Miller), Incremental stim- 
ilation (Mowrer, 1960), or an affective stimulus 
(Young, 1961; McClelland, 1951). 

In the face of all tMs theorizing based on what 
Gilbert Ryle (1949) would c all a para- mechanical 
myth. It seems to me that Skinner has done the 
most consistent thing for a str ictly empirically 
based “science of behavior, ” - namely to shun the 
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notions of causality and motivation altogether. Al- 
though I suspect that he may have led some to hide 
their motivational and causal notions under the con- 
cept of reinforcement, his strict adherence to the 
definition of a relnforcer as so me th Ing that In- 
creases the probability of a response does, in fact, 
rid the science of behavior of all of these irritating 
problems. 

By now, I hope to have laid the groundwork so 
that two conceptions of man as a motivated being 
are clear. The first Is the one we use in our every- 
day dealings with human beings: namely that the 
cause or reason for a person's behavior Is sought 
first within him. More often than not, he is the or- 
igin of his behavior and is to be held re sponsible for 
it. The second is the explanation from scientific 
psychology that seeks a physical source external to 
the person, or at least a stimulus within him, that 
drives him. This latter notion has never been sat- 
isfactory in accounting for the phenomena of human 
motivation and has, through its emphasis on demon- 
strating a physical basis for all behavior, led to a 
psychology of learning and motivation that con- 
ceives of the animal and the human being as a pawn 
to be manipulated b7 reinforcement schedules. 

Accepting at face value the psychological fact that 
people perceive themselves and others as origins in 
most Instances is, for me, the starting point of a 
truly psychological approach to motivation, and de- 
mands a level of analysis quite different from the 
causal chain analysis that attempts to reduce the ex- 
planation to physical events. 1 have tried, there- 
fore, to build on the assumption that the origin- pawn 
dimension makes a difference that is measurable in 
the behavior of a subject. 

The origin- pawn dimension has Its roots In the 
concept of locus of causality used by Helder (1958). 
His emphasis Is on the perception of causality, and 
the result Is that the concept is applied In the area 
of person perception. In perceiving a no the r per- 
son’s behavior, we do attempt to assess whether the 
locus d causality is Internal or external to the per- 
son, and this distinction affects ou r perception of 
the person, the characteristics that we attribute to 
him, and the way we behave toward him. 

Several person perception studies have demon- 
strated the significance of attribution of locus of 
causality (Thlbaut and Rlecken, 1955; Pepltone, 
1958). In our own research, we have demonstrated 
(deCharms, Carpenter, and Kuperman, 1905) that 
subjects clearly do use the origin- pawn variable in 
their perceptions of others. We found that the per- 
ception of a person as an origin or as a pawn is a 
function of several variables, such as whether some 
agent Is attempting to Influence the person’s behav- 
ior or nol. Origin or Pawn perceptions are a func- 
tion of characteristics cf the influence agent, such 
as whether It Is a Urge group, a small group, or an 
Individual, and whether It Is liked or disliked by the 
person. Most interesting, however, was the finding 
that a personality characteristic of the subject 
strongly affected his perception of another person 
along the origin- pawn dimension. Subjects were 
measured on a scale developed by Rotter, See man, 
and Liver ant (1962) that attempts to measure the 
general feeling of powerlcssness or efficacy of the 



person. Since Rotter uses reinforcement 
terminology, he calls the scale a measure of control 
of reinforcements and names it the I-E scale stand- 
ing for internal or external control. There Is a sub- 
tle difference between this concept of control of re- 
inforcements and our O-P dimension, but for now 
the similarities may be noted. Our data showed 
that subjects who reported on the Rotter I-E scale 
that they felt In control of their sources of reinforce- 
ment perceived other people mo r e as Origins, 
whereas subjects at the other end of the I-E scale 
perceived other people more as Pawns. 

Since our primary Interest is motivation, we next 
asked the question: 4 'What effect does feeling like 
an Origin, as opposed to feeling like a Pawn, have 
on the person’s own behavior?” With this question 
we moved from the perception of others to the per- 
ception of self as an origin or a pawn. Two labora- 
tory studies (Kuperman, 1966; deCharms, Dougher- 
ty, and Wurtz, 1965) were devised that attempted 
experimentally to induce the person to f e el like a 
pawn in one situation and like an origin In another, 
and to measure the effects on their behavior. The 
results confirmed the Influence of the origin-pawn 
variable as manipulated in tho experiment. Subjects 
building a tinker toy model under origin conditions 
that attempted to induce a free atmosphere, as com- 
pared to building a similar model under pawn con- 
ditions a) liked the origin model best, b) became 
more involved, c) chose to continue the origin model 
when Interrupted, d) completed the or ig in model 
more elegantly, and e) recalled the nonsense name 
given the origin model more frequently amonthafter 
the experiment. Apparently, the origin- pawn dimen- 
sion can bo manipulated in a way that has strong ef- 
fects on behavior. The Rotter I-E scale was admin- 
istered to these subjects also, but was not related 
to any of the dependent variables, either directly or 
in interaction with the o r i g In -pawn manipulation. 
Evidently, this questionnaire measure re la tes to 
other questionnaire responses as in the pr e v lou s 
study of person perception, but doesn’t predict be- 
havior related to a tack situation, at least for the 
male subjects used here. 

ACHIEVEMENT MOTIVATION 

So far our work on the Origin- Pawn variable has 
not ventured very far out of the laboratory, and we 
have very little empirical evidence about the varia- 
ble In culturally disadvantaged school children. 
What we do have, however, is preliminary evidence 
about the measure of achievement orientations In 
this population, and some evidence that one of the 
aspects of achievement orientation involves acting 
llko an origin. Let us be clear that I am not equat- 
ing acting lihe an origin with having high n Achieve- 
ment. What 1 am doing is looking for a relationship 
between the two concepts, and since I amjust launch- 
ing a project to attempt to measure the O-P variable 
and n Achievement in schools, and already have data 
on n Achievement, I will report the data In hand on 
n Achievement and speculate about the O-P variable. 
The connection is closer than may be apparent. 

McClelland (1961) has spelled out several aspects 
of what he called the achievement syndrome, L e. , 
characteristics of people with high achievement mo- 
tivation. One of the most important aspects is that 
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the achievement motivated person likes to take per- 
sonal responsibility for his actions. He likes tc be 
in a position to act like an or Igln and avoids situa- 
tions where he is a pawn. 

Let us shift our emphasis, then, to the measure- 
ment of n Achievement in culturally disadvantaged 
children? First, let us be very clear abou t one 
thing. The word “achievement” is a loaded term, 
especially In educational circles. A culture such 
as ours, that has been nurtured on Horatio Alger 
stories and McGuffey readers, tends to pe r c e ive 
achievement motivation as an unmitigated virtue if 
not a blessing. If we pull back from this conception 
and ask what aspect of achievement motivation we 
can actually measure, we maybe disappointed. The 
measure to be used was developed about fifteen 
years ago by McClelland and his associates at Wes- 
leyan University, and the subsequent years of re- 
search have told us much about the characteristics 
of people who score high on the measure. The most 
appropriate single word to describe the person with 
strong achievement motivation as measured by this 
technique is that he is an “entrepreneur,” typically 
following a business career. Topcreatlve scientists 
are not particularly high on n Achievement, nor are 
academicians. If you want to succeed in business, 
however, you’d better have highn Achievement. 

The achievement syndrome has three major as- 
pects: 1) personal responsibility, 2) risk-taking 
strategies, and 3) the use of feedback. The entre- 
preneurial spirit of achievement emphasizes self- 
reliance, the taking of calculated risks, careful 
planning and checking of progress with constant em- 
phasis on the skillful use of nne’s abilities. These, 
then, are the dependent variables that are related 
to the measure of achievement motivation. 

What is the measure itself? Actually, even after 
years of research the original form of the measure 
has not been improved very much and is essentially 
a very crude measure. Originally Int e nded as a 
measure of individual differences, it yields at best 
a very rough ordinal scale that is most useful when 
collapsed into a high- low dichotomy, or at most a 
high- medium- low trichotomy. 

Before discussing the weaknesses of the measure, 
let us sketch the procedure for obtaining n Achieve- 
ment scores. The technique involves collecting 
thought samples from subjects under standardized 
conditions by showing a group of subjects several 
pictures, one by one, for a short per lodof time and 
asking them to write a creative story about each in 
turn. The stories are content analyzed by trained 
coders for instances of Achievement Imagery. 
Stories in which one of the characters is concerned 
over obtaining success In competition with a recog- 
nized standard of excellence are said to contain 
achievement imagery. The construct validity of the 
measure is attested by years of research although 
test-re-test reliabilities are often lower than valid- 
ity coefficients (for reasons that we cannot take up 
here). 

Of basic concern to us is the question: Does 
this measure have any utility for the measurement 
of motivation In educational settings and specifically 
in culturally disadvantaged areas? Most of the early 



research results were disappointing In this regard. 
Apparently, n Achievement scores are not very 
highly correlated with school grades or standard- 
ized achievement test scores in high- school and col- 
lege students. As a result, educational Interest in 
the measure lagged after an early flirtation, but It 
has recently been revived by the evidence that it Is 
possible to change the motive by training. Before 
we get dazzled by the thought of changing motives in 
education, we should try to understand the relation- 
ship between n Achievement and school behavior. I 
think there are good reasons to b e 1 1 e v e that t h e 
measure has been misapplied but that it, or aderlv- 
ative of It measuring the O-P variable, may be very 
valuable for education. 

This misapplication of the n Achievement meas- 
ure stems from the two most basic levels possible: 
a lack of understanding of the theoretical basis for 
the measure, and lack of clarity about Its scaling 
properties. 

The problem of understanding the theoretical ba- 
sis for the n Achievement measure i s formidable. 
Exactly why there should be a relationship between 
the content of stories written by a subject in a one- 
half hour period and many other manifestations of 
his behavior, particularly school behavior, Is still 
a problem shrouded in mystery. Twill spare you 
a discussion of several explanatory attempts that 
have been made and present one based on the notion 
that the measure gives a sample of thoughts of the 
subject. 

Let us be very simple-minded and conceive of 
thoughts as a type of response, arbitrarily remove 
them from the ghostlike realmof the mind, and rele- 
gate them to the more prosaic realm of the physical 
world of behavioral events. After all, then Achieve- 
ment measure Is actually based on observable re- 
sponses, not on pure thoughts. From this point of 
view, thought samples are a measure of one domain 
of responses that we wish to correlate with othe r 
domains. Notice in passing that we have made no 
assumptions about a causal chain, that thoughts are 
antecedent to or “cause” behavior. We have a habit 
of thinking that thoughts precede actions but there 
Is very little evidence to substantiate it, and in the 
realmof achievement motivation, there is some evi- 
dence that the behavior may precede the thoughts 
(McClelland, 1966). 

The definition of what constitutes an achievement 
thought is critical in predicting what behaviors will 
be associated with such thoughts. The scoring man- 
ual (Atkinson, 1958) identifies achievement thoughts 
by the term Achievement Imagery and says they can 
be seen in a story when one of the characters shows 
concern over competition with a standard of exc e 1- 
Lenee, Tkr character can show competition when 
any concrete goal Is at stake, such as w 1 n n l n g a 
race, getting a good gra s, becoming a success in 
a career, building a better mousetrap, and so on. 
The non- spec iilcity of the goal of achievement be- 
havior leads us to the s c a 1 i n g problem mentioned 
earlier to which we shall return, but let us pursue 
a little further the theoretical basisfor the measure. 

Thought - sampling is based on an assumed corre- 
lation between thoughts and more concrete behavior. 
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The advantage of using a sample of thoughts rather 
than some other type of behavior is this: of all be- 
haviors, thoughts are least subject to Inhibition. If 
we seek a measure of what a person wants to do, we 
need to rid it of restrictions as to what he can do. 
For this and other reasons, thought- samples stand 
a chance of giving us a better picture of a person’s 
generalized motives. 

In attempting to measure what a person wants to 
do, we must follow quite a different road from that 
taken in measuring what a person Is able to do. Put 
in another way, the measurement of motivation Is 
quite different from the measurement of Intelligence, 
ability, or even attitudes. We want to know what a 
person will do, not what he can do, although the lat- 
ter may form a limit in any particular circumstance. 
In measuring motivation, we sample his thoughts 
under neutral conditions: not when ha is pressured 
and a pawn, but when he can originate some of his 
own behavior. By definition, in such a situation, we 
cannot have control of the kinds of responses ob- 
served. If we tighten control, we lose the ability to 
measure what he will do on his own and end up with 
a measure of what he can do when we pressure him. 

This paradoxical measurement situation Is more 
or less unique and doesn’t fit very nicety Into some 
of the mostbaelc conceptions of scaling. To make 
this a little clearer, think of SkLnner’s distinction 
between operants and respondents. Roughly, a re- 
spondent is a response that we can elicit directly by 
manipulation of a specific stimulus. We more or 
less directly produce a response In the organism by 
external manipulation. Salivary, pupillary, and eye- 
lid responses are examples. An operant is quite 
different. Although Skinner assumes that this type 
of response is probably elicited by so me stimulus, 
we don’t know and may never be able to know what 
it is, so we cannot control the response through the 
eliciting stimulus. Ignoring control by reinforce- 
ment for the time being, we measure an operant by 
observing its spontaneous emisslonunder conditions 
of relative freedom. 

Lotus now conceive of thought sampling as meas- 
uring the rates of spontaneously emitted thoughts, 
i. e. , as the measurement of operants. Here we 
launch Into new territory. While Skinner Is primar- 
ily concerned with shaping a specific operant and 
converting uncontrolled behavior Into behavior that 
is under the control of the experimenter, we are 
concerned with measuring a generalized classof op- 
erants in the realm of thoughts and relating this 
measure to other more concrete behavior patterns. 

This leap raises many problems, but the major 
methodological problem is that our measure of a 
generalized class of spontaneously emitted thoughts 
cannot K e assumed to result In a conventional scale 
characterized by transitivity along an Intensity 
dimension. Let me try to Illustrate this: Pictures 
used to elicit thought samples from which n Achieve- 
ment scores are derived show a variety of charac- 
ters, for Instance, a high-school student, two Inven- 
tors, some businessmen, etc. In what sense can a 
person (A) who writes achievement stories about In- 
ventors, doctors, and businessmen and attains a 
high score be said tobehigher on n Achievement 
than another person (B) who writes an achievement 



story about a hlgh-school boy but not about Inventors, 
doctors, and businessmen and receives a relatively 
low score? If we observe many types of behavior In 
many situations, we may assume that person A will 
show more general achievement behavior than per- 
son B. But if we measure only school behavior, the 
reverse may be true, hi an unpublished study, we 
have demonstrated that a six picture measure of n 
Achievement derived from a standard set does not 
meet the criterion set by the Guttman technique for 
unidimensional scalability (Stcuffer, Guttman, Such- 
man, Lazarfetd, Starr, and Clausen, 1947). 

Does this mean that the measure Is simply unre- 
liable? I think not, although it does mean that it is 
not a unidimensional measure of the intensity of a 
motive to do a very specific thing and, therefore, 
should not be expected to relate to or predict rather 
specific behavior, such as that expected on a stand- 
ardized achievement test taken under conditions that 
produce respondent, or at least discriminated oper- 
ant, rather than spontaneously emitted operant type 
behavior. It would be nice to be able to measure 
motivation along an intensity scale, and most of mo- 
tivation theory influences us to think of motivation 
in terms of intensity concepts suchasneedanddrlve. 
If we think back for a moment to the discussion 
of the Origin-Pawn dimension, however, we can see 
that a generalized measure of what a person will do 
when not forced may come closer to our concept of 
motivation than an intensity measure of what a per- 
son can do when pressured. 

In the book presenting the original development 
of the 11 Achievement measure, McClelland, Atkin- 
son, Clark, and Lowell (1953) briefly mentioned that 
the technique measured the extensity of Achievement 
thoughts in a broad realm rather than the Intensity 
of such thoughts. This mention har apparently been 
lost In the flood of research, most of which was not 
careful to note the the distinction. 

As suggested above, a careful analysis of the ba- 
sic process Involved In the measurement technique 
glve3 some insight Into the low cor relations be tween 
n Achievement and academic performance. It gives 
us more. 1 think it gives us the basisfor suggesting 
that n Achievement scores will be related to much 
more general response patterns. Since the measure 
taps thoughts about achievement in several areas, if 
a person who has many such thoughts is o b s e r v ed 
over a period of time in which he may be confronted 
with some of these situations, we should be able to 
predict that he will react In achievement ways more 
often than not. In view of the analysis, It may be ex- 
pected that the measure of n Achievement will be 
more valuable in relation to cultural orientations 
(McClelland, 1961) and long term career patterns of 
individuals, than in predicting specific re s po n s es 
such as school achievement or exam-taking behavior. 

One example may be cited. McClelland (1965) re- 
ports that of the original sample of subjects tested at 
Wesleyan in the validation procedures for n Achieve- 
ment fifteen years ago, large numbers have gravita- 
ted toward entrepreneurial bus l ness occupations 
subsequent to graduating from college. A check of 
the alumni directory indicated that 63 percent of the 
men who could be classified as entrepreneurs now, 
had high n Achievement scores as sopho mores in 
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college. Only 21 percent of those classified as non- 
entrepreneurs had high n Achievement. These r e- 
sults Indicate that n Achievement predicts career 
patterns over a crucial period of life when career 
choices are being made. 

When it comes to measuring motives in culturally 
disadvantaged children, we have a lot to learn. The 
data that I have to report results from a study that 
was initially intended to answer some of the most 
rudimentary practical questions such as “Can 
thought samples be collected from this population, 
i. e. , can they produce scorable sto rie s under 
standardized conditions?” If it turns out that the 
thought samples are scorable, we can ask whether 
the n Achievement score is valid for this population. 
Is the score, for instance, related to risk-taking 
strategies in this population as it is In middle-class 
high- school and college students? Since we were 
Interested in beginning to probe the Origin -Pawn 
dimension In this population, we cought an existant 
measure that would give an estimate of the children’s 
relative feelings of powerlessness. In short, we 
tested the feasibility of collecting thought- samples 
and found fifth, sixth, and seventh grade disadvan- 
taged children quite capable of producing scorable 
stories. We devised a risk-taking situation that had 
the bonus of providing us with a measure of school 
skills, and we used a measure of powerlcssness. 

The subjects of the study were ninety-four Negro 
children in two fifth and seventh grade classrooms 
in one large city (sixty girls and thirty-four boys), 
and 1 20 Negro children from several sixth grade 
classrooms In another large city. Both samples 
were taken from school areas known to be the most 
culturally disadvantaged in each city. Howe v e r , 
since we were primarily interested in testing the 
feasibility and validity of the motive measure, w e 
did not sample meticulously, nor did we carefully 
assess the comparability of the areas. For this 
reason, comparisons between the two samples are 
dangerous. 

THE MEASUREMENT OF ACHIEVEMENT 
MOTIVATION 

After introductory remarks, the children were 
handed a six- page form with a different cue typed 
at the top of each page, and four standard questions 
equally spaced on each page to help them complete 
their stories. The verbal cue was read aloud (e. g. , 
“Two men are working at a machine. ”), and the 
children were given four minutes to w r i t e their 
stories. In all, six stories were required. 

These stories were content analyzed by the pro- 
cedures described by McClelland, et al. (1953) by 
two Independent scorers. Inter scorer reliability was 
approximately 90 percent agreement between scorers. 

THE MEASURE OF POWERLESSNESS 

The children’s form of the measured powerless- 
ness (Blaler, 1961) was administered immediately 
after the measure of achievement motivation. Twen- 
ty-three statements are presented in simple lan- 
guage and the child circles either “Yes” or “No” 
Indicating whether he agrees or disagrees with the 
statement. For example, one item was, “Does It 



ever help any to think what you will be when you 
grow up?” 

RISK-TAKING BEHAVIOR 

In a game situation in which t he person can 
choose to shoot for a fixed target from varying dis- 
tances of increasing difficulty with increasing re- 
ward attendant on success, a group of high- achieve- 
ment persons will tend to take more shots in the 
middle range, avoiding both easy and extremely 
hard shots. A similar group of low -achievement 
persons will take more shots in the easy and ex- 
tremely hard positions (cf. , Atkinson, Bastian, 
Earl, and Litwin, 1960). The range of risk which 
may be considered a moderate risk Is dependent up- 
on the skill of the individual and is evidently chosen 
in terms of where he thinks he has a moderate 
chance of success (cf. , deC harms and Dav£, 1965). 

We rejected the simple game situation most often 
used. Instead, It was decided to attempt to develop 
a new situation completely analogous to the game 
utilized in our earlier work but involving the typical 
school behavior of children, i. e. spelling and arith- 
metic skills. 

SPELLING AND ARITHMETIC SKILLS 

Each of these measures was comprised of sixty 
items divided Into six levels of difficulty of ten 
items each. Spelling words were taken from stand- 
ard lists calibrated for difficulty, and arithmetic 
problems were taken from a series of arithmetic 
textbooks used in the schools fro m early elementary- 
grade level to Junior -high -school level. Extensive 
pretesting was used to assess empirically the valid- 
ity of the various levels, and to assure a highdegree 
of success for all children in the easiest level, and 
increasing difficulty up to a level where little suc- 
cess could be expected from any child. 

These measures were administered by standard 
classroom procedures. The Items were arranged 
in blocks of six, each block progressing from the 
easiest to hardest level of difficulty in order, though 
this was not made obvious to the children. It w as 
stressed that this was not a test in the sense that the 
children would receive grades, but that they them- 
selves would learn from this about their own skill. 

After all children had attempted all sixty items, 
the various levels of difficulty were explained to 
them and their own ability at each 1 e vel was im- 
pressed upon them by pointing out how many they 
had completed correctly at each level. 

SPELLING AND ARITHMETIC RISK-TAKING TASK 

After the group session, the experimenter met 
with each child Individually. She made sure that he 
understood the various levels of difficulty In the 
sixty Items he had attempted, and how many he had 
completed correctly at each leveL 

The child was told that he would now take a t e st 
in which he could choose each time the level of diffi- 
culty of the Item which he would attempt. It was 
made clear that the test items were divided into lev- 
els comparable to those of the previous skill task. 
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Before he was presented with each item, he was to 
choose the level of difficult/ which he would like to 
attempt on that trial. The object was to attain 
“points," the significance of whichwas left unex- 
plained, as In a game. The points that could be won 
by correctly completing the Item increased with the 
level erf difficulty of the item chosen. These points 
were established for each child separately, accord- 
ing to the empirically established level of difficulty 
for Mm. Thus, a skillful child who chose level five 
(a difficult level), and ^ho had done four out of ten 
Items correctly at that level in the skill-task (e m- 
pixlcal probability of success equals . 40), stood to 
gain thirty-eight points If correct. A less sk»/?ul 
chHd choosing the same level five may have done 
only one out of ten Items correctly at that level In 
the skill-task (empirical probability of success 
equals . 10). Such a child could win 150 po in 1 8 If 
correct at level five. (This procedure, developed 
by deCharms and Dav£ (1965), equates subjects as to 
skill and emphasises choices in terms of tho child’s 
own chances of success.) 

Each time the child chose a Levelfor the uxt Item 
(of ten spelling and ten arithmetic Items), he was 
asked to consult b*s own paper from the ski 11- 1 ask 
and re port how many he could expect to get r 1 g h t 
out of ten (Ms probability of success at that level). 
He was then asked to concult the following table and 
report how many points he could win. The point 
scale was constructed so that the number correct 
multiplied by the number of points slways approxi- 
mated a constant (1$0) as closely as possible without 
using decimals. The expected value of ten trills at 
any level, therefore, equals 156. 
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By such means the experimenter made every ef- 
fort to Insure that the cMld thought of his c ho l c e a 
In terms of his own performance on the sklll-t ask 
and In terms of the possible points which were as- 
signed in accordance with Ms own de mo n sir sled 
skill. 

Each cMJd made ten choices and attempted ten 
spelling words, recording Ms accrued points after 
each trial Following this, each child aid the same 
with arlthe. rtlc Items. 
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Table I presents the mean skill Mores on arith- 
metic and spelling tasks by sex and level of achieve- 
ment motivation. You will note that the means for 
the high a Achievement subjects are higher In alt 
cases 'has the means for low n Achievement t ob- 
jects. The differences tested by analysis of t ar I- 
anee are significant In every case except for arith- 
metic fer girls. There Is clearly a relationship over- 
all between n Achievement level and school skills 
aa measured by our test. The r e 1st * onshl p Is 
stronger for boys than for girls, but all dtffs rences 
are scull, a fact 'hat Is attributable fo the low nr 
lances of (he Mores. The 60-Item ta ck was de- 
signed so tt*t the mijorry of the subjects would 



success on almost all of the items at the easiest 
level and fall on a T *nost all at the most difficult lev- 
el. As a result, the range of probable sc o 1 e s Is 
much smaller than the total range of sixty, and the 
variances axe quite small. In addition, these re- 
sults come from a larger analysis wheie variance 
attributable to other fartors, such as grade level, 
was extracted. 

Table 2 presents data from the same dependent 
variables, spelling and arithmetic skills, but this 
time showing the relationship with the I-E scale. 
The low I-E subjects feel relatively powerless. The 
relationship Is significant In both cases of arithme- 
tic and spelling skills for girls but n o t for b o y s . 
This sex difference is more or less the opposite of 
what was found with n Achievement. These results 
seem to Indicate thafthe though; sample measure Is 
more powerful In predicting school skills for boys, 
whereas the questionnaire measure la more power- 
ful for girls. The data by themselves are not very 
impressive In tMs respect, and might seem merely 
a function of the specific tests except for two things. 
First, we have argued that thought sampling results 
in a different kind of score from that derived f r o iq 
a questionnaire, and the difference Is interesting the- 
oretically. Second, a recent review of the literature 
of n Achievement Indicates a similar trend toward 
an Interaction between sex and type of testing situa- 
tion. Klinger (1966) reviewed some forty-four stud- 
ies that investigated the relationship between meas- 
ures of achievement motivation and task perform- 
ance. Some of the studies used the thought- sample 
technique which Kllr^er calls the TAT, and some of 
them used a measure called the Iowa Picture Inter* 
pretatkm Test, or the IPIT. Thlstertuses pictures 
but supplies several plot* for the subject to cboose 
from in s multiple choice form. Klinger says: "The 
studies also suggest an i^icractlon of Instrument X 
Sex of Subject, in that of the studies that u sed the 
TAT, s higher proportion of those with male subjects 
reported significance than those with femsles, while 
the reverse wss true with the IPIT” (Klinger, 1966, 
pfK 297-296). Klinger makes no attempt to explain 
this interaction. 

in view of our analysis of thought sampling as a 
measure of a more or tess "free” operantwhere the 
subject emits responses, whereas i quest k>nn Lire or 
multiple choice measure supplies ready-made re* 
tponses for the subject to choose from, It teem 
reasonable to hypothesise that the free operant mess- 
ure may be more appropriate for male subjects and 
a respondent (or dlMrlmlnated operant) tn e s s u r e 
more appropriate for females. I cannot pretend to 
expiata In detail why this should be so, but It does 
seem plaustole, especially In the achievement ares, 
*nd In our culture, that men are expected to product 
achievement behavior spontaneously, whereas women 
nay hare to respond spproprlately with achievement 
behavior when pressed but are not necessarily 
expected to initiate it on their own. W e hope to In- 
vestigate this possibility In the near future. 

The results from the risk-taking data a r l re- 
sented In Tables I and 4, and maybe seen tr ,ures 
1 sod a. The means In the tabtes need all ie ex- 
planation. The hypothesis der 1 red from exrlier 
studies piedkts that sheets with high achievement 
ucHratkon will more often choose spelling words or 
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TABLE 1 

MEAN SPELLING AND ARITHMETIC SCORES (OF A POSSIBLE $0) BV SEX AND LEVEL OF 
n ACHIEVEMENT 



Boys Girls 







Math** 


Spelling** 


Total 


Math 


Spelling* 


Total 


High 


N 


46 


46 




60 


60 




n Achievement 


X 


21.7 


26.2 


24.8 


22.5 


31.0 


26.8 


Low 


N 


51 


51 




63 


63 




n Achievement 


X 


18.5 


21.7 


20. 1 


19.6 


26. 5 


23. 1 


Total 




20.0 


24.8 


22.4 


21.0 


28.7 


24.9 



* p . <.05 

** p . <.01 

TABLE 2 

MEAN SPELLING AND ARITHMETIC SCORES (OF A POSSIBLE 60) BY SEX AND 1*E LEVEL 
(POWERLESSNESS) 



Boys Girls 







Math 


Spelling 


Total 


Math* 


Spelling* 


Total 


High 


N 


46 


46 




69 


69 




1-E 


X 


20.9 


25.2 


23. 1 


22.6 


29.8 


26.2 


Low 


N 


51 


51 




54 


54 




I'E 


X 


19.3 


24.4 


21.9 


19.0 


27. 2 


23.1 


Total 




20.0 


24.6 


*2.4 


21.0 


28.7 


24.9 



*£. <.05 



arithmetic problems In the middle ranges o( prob- 
ability levels from say 30 percent to 3 0 pe rcent 
probability, while Subjects with low n Achievement 
will not show this tendency to as great an extent and 
may, In fact, avok the middle ranges and choose 
more extremes either around 00 percent or 10 per- 
cent. 



hypothesis then predicts that subjects wllh high n 
Achievement will have smaller average deviation 
scores than subjects with low n Achievement. Ta- 
bles 3 and 4 present the means ©4 the average devi- 
ation scores from each group. We shall call this 
score the risk score. 



tn order (o extract a measure from the data to 
test this hypothesis stitfstkalty, we used a proce- 
dure developed ty deCharms and Davl (1565). The 
average deviation of the ten probability choices for 
each subject Is measured around the overall mean 
of all choices foe all subjects. A large average de- 
viation indicates that the individual subject's chokes 
range farther out In either direct!©* on the scale; a 
small average deviation Indkates that the subject's 
chokes are concentrated ta the middle range. The 



Table 3 gives strong support for the hy pot he sued 
relationship between moderate risk-taking and high 
n Achievement under all conditions, I. e. , for both 
boys and girls and when the task involves either 
spe Ming or axithmetk problems. Table 4 Indicates 
that the I-E scale Is not related to risk-taking under 
any conditions. 



A look at Figures I and 2 may make the results 
with a Achievement clearer, Figure I combine* 
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TABLE 3 

MEAN RISK-TAKING SCORES BY SEX AND LEVEL OF n ACHIEVEMENT 
(LOW MEAN INDICATES MODERATE RISK) 









Boys 


Total 




Girts 


Total 


Math* 


Spelling* •• 


Math* 


Spelling*** 


High 


N 


46 


46 




60 


60 




n Achieve merit 


X 


>9.2 


24. 2 


21.7 


22.0 


23.3 


22.6 


Low 


N 


61 


61 




63 


63 




n Achievement 


X 


23.6 


29. 1 


26.4 


24.4 


27.9 


26.1 


Total 




21.6 


26.6 


24. 2 


23.2 


25.6 


24.4 


« £ . <.05 
















••*£. <..005 
















TABLE 4 
















MEAN RISK-TAKINO SCORES BY SEX AND LEVEL 1*E (POWER l ESSNESS) 






(LOW MEAN INDICATES MODERATE RISK) • 
















Boys 






Girls 








Math 


Spelling 


Tohl 


Math 


Spelll.^ 


ToUl 


High 


N 


46 


46 




69 


69 




I*E 


X 


21.7 


27.6 


24.6 


22.7 


25.3 


24.0 


Low 


N 


51 


61 




54 


54 




I-E 


t 


21. 5 


26.2 


24.4 


23.8 


26.0 


24.9 


Total 




21.6 


26.6 


24.2 


23.2 


25.6 


24.4 



•No * If nine ant differences 



boys and girl* tod shoirs a high peak in the mid 
ra/*et of probabilities of success for the higho 
Achlerement subjects on arithmetic problems. The 
curve for the km a Achlerement subjects shows an 
Interesting propensity to take extremely speculative 
risks. For the low o Achievement subjects 58 per- 
cent of the chokes are In the rsnge of 0 to 40 per- 
cent probability of success. 

Figure I presents the results for spelling. Be*: 
the high a Achievement curve shows a hur : ? In the 
middle, and the low a Achievement Curve ac Unity 
shows a trough In the* middle ranges and Is higher at 
both extremea as predicted by the hypothesis. 

These results with arithmetic and spelling tasks 
show s clearer differentiation in risk-taking strate- 
gies between high and low a Achievement subjects 
than most previous studies* in this ares, and suggest 



the possibility that risk-taking on s s e r lo a s task 
such as spelling or arithmetic is more clearly a 
function of a Achlerement than onthegsmerllhe 
tasks used In other studies. It Is also possible that 
the effect of achlerement motivation may be more 
clearly evident In the culturally disadvantaged envi- 
ronment than in the Nghty competitive middle class 
Culture where the range of o Achlerement scores 
may be skewed toward Mghji Achievement 



OttOftUON 



All of the results reported from this study were 
derived from two different samples that were com- 
bined for simpiklty of presentation. When the sam- 
ples are Investigated separately, the f ladings re- 
ported reptkate in almost every case. 
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Figure 1. Percentage of tasks chosen at each Level 
of probability of success on the arithmetic risk* 
taking task by subjects above and below the median 
n Achievement score. 




which these scales derived were intended originally 
merely to give preliminary data fot the risk-taking 
task. The fact that the relationship* with n Achieve* 
men! are significant at all Is surprising and even 
embarrassing since the major thrust of o»ir theoret* 
leal argument predicts that the a Achievement me as* 
ur e should be more highly related to measuresof 
change over time than to single test measures such 
as these arithmetic and spelling Skill tasks. Actual* 
ly, the results, though significant, are not indict* 
live of high correlations, but of relationships quite 
commensurate with others reported between n 
Achievement and rcademk achieves*' Akhcwgh 
we have argued that a Achievement la primarily 
a measure of the extensity of though!* about achieve* 
ment and should, therefore, be related lo long-term 
trends In behavior, out data remind us that a meas- 
ure of extensity ts not completely independent of In- 
tensity. To use the extensity measure exclusively 
at a measure of Intensity Is to misapply It; but the 
extensity of thoughts about achievement may give 
son* indicator* of the Intensity of achievement mo- 
tivation Is a ipeclfk area. 

Probably the most interesting rewlt of these pre- 
llmjiary forays into the study of mot i vat loo to c a 1* 



Figure 2. Percentage of tasks chosen at each level 
of probability of success on the spelling rlsh-taklng 
task by subjects above and below the median n 
Achievement score. 
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totally disadvantaged children La the evidence that 
the thought sample measurea are more effect Ive 
with boys than girls, and with the que stlor. n ai r e 
measure the reverse Is true. If this result stands 
upon replication, it may lead to further insights 
about thought sampling. 

ft should be clear by now that the I*E scale used 
here was not designed to measure the origin* paw.i 
dimension, ft is our hope that a measure of this di- 
mension can be devised based on thought sampling. 
To be valid, the measure must allow the subject to 
emit his own behavior. Choke of reactions selected 
and pretented by the experimenter as on a question* 
nalre limits the subject. We are at present begtonlrg 
to develop a measure based on thought samples, and 
preliminary evidence Indicates that It Is feasible 
and may be related to the measurea of school skills 
discussed here and even to long-term In die at ions 
that a person prefers to take personal responsibility 
for his actions. 

We can only end this paper by noting that Ills 
only a beginning. The research reported here con- 
stitutes the basts for a project that Is J ■ at getting 
under way, the aima of which are to relates 
Achievement to charge to academic skills in a torgt* 
tudtoal study, to develop the coocf(< and measure 
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the origin-pawn dimension, and ultimately todevelop 
training techniques for teachers and pupils similar 
to those used in achievement n otivatlon training 
courses with businessmen (McClelland, 1965). 
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CURRICULUM improvement in the various disciplines has been ham- 
pered by lack of adequate research paradigms to determine the effectiveness of 
various instructional programs, by lock of relevant learning theory, and by inade- 
quate conceptualizations for determining the content to be learned. The structure 
of the discipline itself, as formulated by one or more scholars, has provided 
much of the basis for recent curriculum development. E. G. Begle in "Curricu- 
lum Research in Mathematics" cites the extensive work of the School Mathematics 
Study Group in the development and evaluaticn of a mathematics curriculum. The 
structure of mathematics has proven to be a powerful o.ganizer for the mathe- 
matics curriculum at the university, high school, junior high school, and now at 
the elementary school levels. The point of view adopted is that in learning rr-the* 
matics each pupil is to build his own structure of mathematics. Such a structure 
starts with a small number of concepts and eventually incorporates strategies of 
problem solving. Begle argues that the necessary framework would be charac- 
terized by three aspects! "1) the mathematical content of the curriculum, 2) a 
theory of learning of the content, and 3) a theory of the application of the con- 
tent to problem solving." Begle reports that some of the results obtained by the 
School Mathematics Study Group are being investigated in a National longitudinal 
Study of Mathematical Abilities. 

Similar problems of curriculum research and development are com- 
mon to science. Arthur Livermore examines the structure of science (a science of 
science) as the basis for curriculum reform. Reports of the various curriculum groups 
(RSSC in physics, BSCS in biology, and CHEM and CBA in chemistry) indicate a 
union of scientists, educators and psychologists working together on the prob- 
lem of curriculum design and evaluation. The evolution of the so-called new 
curriculum in science can be characterized as starting effectively first at the 
high school level, then junior high school, and now at the elementary school level. 
While these curriculum studies emphasize concepts of importance within the re- 
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spective disciplines, corresponding emphasis is also given to the empirical aspects 
of science as represented in the laboratory activities common to all of the curricu- 
lum studies. For example, the American Association for the Advancement of Science 
has produced a program for the elementary school which emphasizes the process 
approach to science. In this approach certain cognitive skills are used as the or- 
ganizers of the curriculum. However, the lack of an encompassing conceptual 
framework in the science inhibits the development of a systematic curriculum 
K-12. Rather several well-prepared curricula are being developed at the various 
school levels. 

Curriculum development in English is also dependent on the struc- 
ture of that discipline. Robert Pooley discusses various efforts at developing cur- 
riculum rationales and materials in such areas as literature, composition, lan- 
guage, and in the emerging grammars of the English language. Development and 
research underway in the various oreas are reported with particular emphasis 
given to the structural and transformational grammars. 

Reading ability is of fundamental concern in the usual curriculum. 
The demands placed on the learner vary across age, and across subject matter, 
yet the student is not trained n techniques of reading science, mathematics or 
English. A research paradigm appropriate to investigating variation in the rate 
of reading is reported by Wayne Otto, Theodore Harris, and Thomas Barrett in 
"Research in Reading." The authors investigate the question of "whether varia- 
bility in reading speed developed by training with carefully constructed, short 
model paragraphs will transfer to reading the less tightly structured passages 
typically found in classroom material." Expensive details on procedures and re- 
sults are reported. 

The contribution of psychological research to the development of 
curricula in mathematics is expanding, according to Myron Rosskopf. I.e cites 
the work of various psychologists in discussing the attainment of mathematics con- 
cepts. The effect of the learner's system of focusing on the problem at hand and 
the ovciloble strategy of problem solving are discussed. 
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I SHALL Interpret “curriculum" In 
the above title very broadly, since 1 believe that re- 
search In mathematics education must Involve re- 
search on the learning of mathematics, the teaching 
of mathematics, problem solving, etc. , as veil as 
the syllabus, and that exclusive concentration on any 
one aspect of this complex Is not fruitful. 

1 shall not attempt a h isto r Ic a I survey of re- 
search In mat he mat lea education. Wearer (19$?- 
1966) has provided useful lists covering researchon 
elementary- school mathematics for each year aince 
19$1. Brown (195$, I960, 19$$, 196$) has provided 
biennial an noted reporta of researchon math? mat k a 
teaching carried out t'lnce 1956. A glance at these 
reports Indicates that a considerable amount of re- 
search has been done In the post and also that the 
volume of research Is Increasing rapidly. A more 
careful look, however, provide a the melancholy in- 
formation that this Urge number of research efforts 
yields very little that can be used to Improve math- 
emalka education. This Is nof to say that all these 
efforts have been wasted. There are in f act many 
Ingenious Ideas and suggestions which ought to be 
followed up. tn general, though, the results are 
too special or Incomplete to be of any wide use. 

h doea not take much reflection to see why this 
should be the case. Research In education In ge n- 
eral, and In mathematics education In particular, It 
much more difficult thrn research In say, psychol- 
ogy or chemistry. Far one thing, the number of 
variables that should ?* taken Into accovnt la ve r y 
Urge. Mathematics ncMevement c a n be affect**, 
at least in theory, by the prior learnings of the sub- 



jects, by a wide variety of cognitive abilities and 
cognitive styles, by attitudes toward mathematics, 
aM, as vt tell know, by socio-economic and demo- 
graphic va/iables. Similarly the cognitive and af- 
fective state of the teacher may well affect the stu- 
dent's learning of mathematics. 

In order to isolate and compare izodlfferentcur- 
rkulum treatments, for example, it Isnecttsary to 
take all these variables Into account so that the ef- 
fects due to these variables will not be co, founded 
with those due to the currkulum treatments. To do 
this generally requires either a large experiment or 
a large number of carefully correlated small ones. 

Until very recently, It ha a been almost impossi- 
ble lo meet this requirement. Experiments In math - 
ematka education have been carried out by Individ- 
uals with limited resources. The experiments of ne- 
cessity were small In Kale, involved relatively 
amall numbers of subjects, and had a abort 1 1 me 
span. Only very recently has financial support be- 
come available whkh makes possible some of the 
studies and experiments necessary tor algntfkrnt 
improvement in math«malks education. 

A large Kale investigation now being carried out 
by the School Mathematics Study Croupls the Nation- 
al Longitudinal Study of Mathematkal Abilities (Ca- 
hen, 1961). 

In this study three groups of students entering 
grades 4, ?, and 10 In September, 1969, totaling 
over a hundred thousand, will have been followed for 
five years. The mat he mat k a achievement of each 
of these students has been measured twke etchyear. 
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The primary purpose of this study Lsto ascertain 
the effects o( the new mathematics curricula in or- 
der to provide guidance for further curriculum de- 
velopment 

It was necessary, of course, to measure not on- 
ly the level of mathematics achlevemertof each stu- 
dent at the beginning of the study, but also as many 
as possible of the other variables which might affect 
the results. We have therefore obtained measures 
of a considerable number of cognitive variables, 
selected by our psychological consultants, for their 
probable relevance to mathematics achievement. An 
extensive attitude Inventory was administered three 
times during the study, since we want to know how 
attitudes affect achievement and also how achieve- 
ment affects attitudes. We have some information 
about the socio-economic status of the students as 
well as information about the schools. Most of the 
teachers of the students included In the study have 
provided us with extensive Information about their 
training ard experience, and more than half of them 
have also provided Information about IheL l rttltudes 
toward mathematics, teaching, etc. 

When we analyse this enormous massof Informa- 
tion, we will not only find out what we want to know 
about the differential effects on mathematics achieve- 
ment of modern curricula as compared with conven- 
tional ones, but we will also obtain as a by-product, 
Information on the effects on mathematics achieve- 
ment of the other variables we have measured. 

This kind of information should prove valuable 
both to the design of future experiments a n d In the 
interpretation of past results. Hopefully we will 
find that many of these variables have little or no 
effect on mathematics achievement. When this Is 
the case, future experiments Involving similar stu- 
dents need not take such a variable into account, 
and we will have more confidence if. gene rail z log the 
results of past studies which did not controlon such 
a variable. 

However, while studies such as this one will 
prove very helpful, It Is doubtful that they will prove 
sufficient. There Is another fundament'll problem 
which must be overcome before we ca:i expect sig- 
nificant Improvements In mathematics e due at Ion. 
This problem is the lack of any theoretical frame- 
work for mathematics education. Without iuch a 
framework, one whose broad outline has reasonably 
widespread acceptance, there is noway to program 
the many individual small studies which will con- 
tinue to be undertaken so that they can be mutually 
reinforcing and can contribute to overall forward 
progress. It Is my belief that the time Is ripe to 
begin the construction of such a theoretical frame- 
work. 

THE MATHEMATICAL CONTENT Of THE 
CURRICULUM 

One aspect of It of course will be concerned with 
the mathematical content of the curricula in. Before 
discussing this, t will turn to what m ay seem at 
first to be a digression. ! am sure that many of our 
teachers look on our now Crrrkula as t revolution 
in school mathematics. In a s^nse this is correct, 
but it is merely a small aspect of a revolution In 



mathematics itself which has been going on for a 
century and a half. 

This revolution stems from ihe work of Abel and 
Galois. When Abel demonstrated the nonexistence 
of an algebraic formula for the solution of the quin- 
tic equation arid wh r -n Galois applied his methods to 
settle the general problem, the direciion of the de- 
velopment of mathematics was changed forever. Ob- 
viously they did not obtain their results by lime- 
honored computational procedures. Instead they dem- 
onstrated that an examination of the over-all struc- 
ture of a mathematical system, in contrast to com- 
putations with the individual elements of the system, 
was a very powerful mathematical tool and could 
lead to solutions of problems not otherwise solvable. 

Although the revolution dates backto the previous 
century, it gathered momentum slowly, and it was 
only in the present century that 1 1 s effects became 
overwhelming. The tremendo-ia flowering of modern 
algebra and of functional analysis which st a r ted 
early In this century could not have taken placewlth- 
out the Ideas about structure first po in ted out by 
Abel and Galois. 

During the 1930‘s these ideas began to be applied 
In the graduate curriculum, and it became clear that 
these Ideas, already demonstrated to be pow e r f ul 
and Indispensable in mathematical research, were 
also powerful and effective In mathematics instruc- 
tion at this level. During the next two decades a 
start was made on a revision of the undergraduate 
curriculum in the universities along the same lines. 

Consequently, when mathematicians Joined with 
hlgh-cchool teachers in an attempt to i mprove the 
secondary-school curriculum, their first Inc 11 n a- 
tion was to apply to the subject matter normally 
taught In these schools the same point of v I e w to* 
ward mathematics, an emphasis on structure, which 
had proved successful not only in mathematical re- 
search b» ♦ also In mathematical education at the uni- 
versity level. When it was discovered t hat this 
could be done successfully for the secondary- school 
curriculum, the reform movement continued and re- 
vised the elementary- school curriculum In the same 
spirit. 



There are two Important observations which now 
need to be made. The first is that thl s revolution 
has been successfully concluded. The second is 
that r>o new revolution Is clearly In sight. E t e n if 
the first stirrings of a new revolution might be tak- 
ing place In mathematical research, its effects 
could not appear In Ihe pre -college program for gen- 
erations. Consequently we can agree on the broad 
outline of the content of the mathematics curriculum 
for the schools. 

This content Is we 11 enough known that we need 
not spell it out here in detail. Suffice it to mention 
that the mathematical topics included in the curric- 
ulum are, with few exceptions, those Included In the 
pre- revolutionary curriculum. Only a few sew 
topics, such as Inequalities, have been added be- 
cause cf their intrinsic importance, and only a few 
other topks have been given lesser emphasis than 
before. 
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On the other hand, the new curriculum differs 
radically from the old in that it includes the struc- 
ture of the common mathematical systems, the 
basic mathematical concepts and their Interrelation- 
ships, as weU as the basic mathematical facts and 
techniques. 

Before discussing the Implications of this new 
aspect of the curriculum for our theoretical frame- 
work for mathematics education, it Is well to point 
out that while few new topics have been Incorporat- 
ed In the curriculum so far, there will undoubtedly 
be new ones to be added from time to time. The na- 
ture of our society at present Is such that it would 
be wise to include as soon as possible, and for all 
students, some of the basic ideas of probability and 
statistics as well as someof the mathematical Ideas 
relevant to high speed computers. Incorporation of 
any such new topic into the curriculum will require 
research to determine t he prior understandings 
needed by the student, the most efficient location of 
the topic In the sequence, etc. We c an certainly 
look forward to a continuing need for this kind of re- 
search. 

Returning now to the curriculum, we see that 
our aim in mathematics education is to h e I p eacn 
student to build in his mind t conceptual structure. 
This structure, for primary- schoolchildren, starts 
with a small number of concepts, abstracted di- 
rectly from the rest world, about number and geo- 
metric configurations. As the child progresses 
through school, these concepts are ref I ned and 
sharpened, and the relationships between them be- 
came Increasingly complex. At some stage, new 
concepts are met which come not from the real 
world but rather from previously teamed concepts. 
The concept of Irrational number is a case at point 
Among these concepts there are, of course, those con* 
cerned with computation. For example, we do not 
ask our students to memorise sninftnUe multiplica- 
tion table. Rather, we let them stop after 9>9 and 
teach them the algorithm for mult I pi Ic at ion, ard this 
is a concept. 

Naturally, the order in which mathematical con- 
cepts are learned la subject to some variation, and 
miKh research time could be devoted to studying 
the effects of variations in the sequence. However, 
In my opinion, most of this time would be more use- 
fully employed if devoted to some of the problems 
discussed below. 

A THEORY OF THE LEARNING OF THE 
CONTENT 

What this means for us Is that our theoretical 
framework for mathematics education must hare as 
one of Its many aspects a theory of the terming of 
mathematical concepts and relations between these 
concepts. 

No we It- developed theory of this sort now exists. 
One's first thought, when the topic of I e a r M n g of 
any sort Is brought up, Is to turn to Our colleagues 
In psychology for sdvke and assistance. A very re- 
cent surrey of concept growth t* children Wallace, 
1965) shows that psychologists can pro v id « very 
few useful answers to out questions. Mi eh work 
has been done in this country on the development of 



concepts, but Interest is usually focused on the 
strategics used by the subjects in trying to g u e s s 
which combinations of color , sires, shapes, etc., 
the experimenter has chosen. Neither the concepts 
nor the strategies have much relevance to class- 
room learning. 

An Interesting by-product, however, of these 
studies is that the availability of verbal labels for a 
concept plays an important role (Kuenne, 1946) and 
will have to be faken into account in any theory of 
the learning of mathematical concepts. 

Some of live investigations of “discovery” teach- 
ing in this country have Involved the learning of 
some non-trlvlal mathematical concepts. Unfortu- 
nately, the results of these studies pr e sent aeon- 
fused picture. Fcr a review of the present state of 
affairs, see Cronbach (1966). 

Outside the U. S. , Investigations of concept learn- 
ing have been dominated by the work of Piaget. He 
deserves great credit, of course, for Investigating 
real mathematical concepts and how children come 
to acquire them. Unfortunately, he generally c on- 
lines himself to the Initial concepts of any branch 
of mathematics and has little to tell us about the 
learning of the later and more refined concepts or 
the learning of relationships between concepts. 

A more fundamental difficulty In applying Piaget's 
findings In mathematics education lies In the fact 
that, when he questions a child to see how well he 
understands a concept, he Is very careful never to 
provide the child with any subsidiary concepts which 
might help him. In fact, he seems to be Inve all- 
gating what children can learn without the benefit of 
education. There are, however, some indication* 
(Kohnstamm, 1965) that the picture Is quite differ- 
ent If children are provided with some assistance In 
the form of subsidiary concepts. 

In short, the task of building a theory of the learn- 
ing of mathematical concepts still ties before us. 
Some Ideas about what will have to be Included In 
such a theory can be obtained from the sources just 
mentioned. It should also be mentioned that some 
very Interesting work, with which we are ju it be- 
ginning to become acquainted, Is being done In Rus- 
sia, and this work may provide us with further clues. 

In order to construct a suitable theory of the 
learning of mathematical cone e pt s f and such a 
theory should be quantitative rather than purely qual- 
itative, It will be necessary to c on sir uc t Instru- 
ments which measure how well a student under- 
stands a particular concept. 

This will not be an easy task. Concepts are not 
observable. It will be necessary to use Indirect 
methods to assess a student's understanding of a par- 
ticular concept. Perhaps we can obtain some guid- 
ance on this from our colleagues In the ptyskal sci- 
ences, w bo also deal with wiobser rabies sue h is 

neutrinos. 

Perhaps the most useful contribution which Pia- 
get has made to Our present efforts is Ms demonstra- 
tion that skillful questioning can provide precise and 
detailed Information about an Individual's understand- 
ing of a concept or problem. Similar Individual In- 
terrogations will *4>doubted?y be an Important tool 
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In the development of Instruments for measuring un- 
derstanding, although the final Inst r u ments will 
need to appear In a more standardized format. It is 
worth observing that Brownell (1963] also has found 
working with individual children a v 1 1 u able pro- 
cedure. 

THE APPLICATION OF THE CONTENT TO 
PROBLEMSOLVING 

A final aspect of our theoretical framework for 
mathematics education Is that ot problem solving. 

It would be futile to provide our students with a 
thorough understanding of mathematics if they were 
not able to use this understanding to 6olve problems. 
Wiiat we need therefore Ls a better understanding of 
how we can help our students todevelopuseful strat- 
egies for solving problems. 

This seems to call for a considerable amount of 
exploratory work. We do have already, however, a 
variety of problem-solving strategies that car be 
Investigated. Polya (1945) for example, has written 
extensively on this topic. In another direction, 
Newell, Shaw, and Simon (1959) have Investigated, 
by means of computer simulation, the jower of cer- 
tain specific strategies. These strategies hadbeen 
identified as ones actually used by at least some 
students, and a computer program then ve r if ie d 
that the strategies were Indeed effective. In still 
another direction is the very interesting work by 
Crutchfield and Covington (Crutchfield, 1966). Using 
comic-book format for their materials, they were 
able to train their subjects to examine the rel tton- 
shtps between the various aspects of a problem sit- 
uation, and the Implications of these relationships, 
for a sufficiently long time and in sufficient depth 
to arrive at a solution. Their problems were not 
mathematical, but their procedures 'tay well have 
Implications for mathematics education. 

The Russian literature, mentioned above, also 
has suggestions of problem-solving strategies which 
are worth ir cStigatlng. 

There are still two other sources which may pro- 
vide us with raw material for investigation of prob- 
lem solving. The strategies used by Nevell, Shaw, 
and Simon were obtained by having a number of stu- 
dents solve problems aloud during Individual Inter- 
views. This procedure may well prove very fruit- 
ful, especially at the elementary school level, where 
we seem to know less than at the hi ghe r levels. 
Similarly, classroom observations of teachers 
teaching problem solving and of their technique a for 
helping students to solve problems may pay good 
dividends. 

In short, we already know a number of problem- 
solving strategies and we have suggestions for lo- 
cating others. What we need to do now Is to start a 
systematic study of tectr.lques for teaching these 
strategies to students and of the ability of students 
to use these strategies. We need to study in partic- 
ular the degree of understanding of th e conceptual 
structure of mathematics a student needs before he 
can learn a particular strategy and use it effectively. 
This points up again the need fer instruments which 
can be used to measure understanding of mathemat- 
ical concepts. 



To summarize briefly, I have been arguing that 
substantial improvements in mathematics education 
will have to be based on more fundamental research 
than has been carried out so far. I have further ar- 
gued that the magnitude of the task ls such that the 
efforts of a Large number of research workers will 
be needed and that these efforts can be made mutu- 
ally reinforcing and contribute to substantial im- 
provement only if there Ls an overall theoretical 
framework which Ls generalty accepted and which 
can be used not only to suggest individual research 
problems but also to relate individual findings In a 
meaningful pattern. 

Three aspects of such a theoretical framework 
were mentioned: the mathematical co nt e nt of the 
curriculum, a theory of the learning of the content, 
and a theory of the application of the content to prob- 
lem solving. The first is, except for minor varia- 
tions, dictated by the nature of mathematics itself. 

It differs from the curriculum content of a genera- 
tion ago by emphasizing the conceptual structure of 
mathematics as welt as routine mathematical skills. 
This part of our theoretical framework, then, Is gen- 
erally agreed to. The rest however, we wilt have 
to construct. We have a few bits and pieces to start 
with, but a great deal of empirical work w i 11 have 
to be done before even the outlines of these aspe :ts 
of our general theory will emerge. 

Finally, I have argued that an essential tool that 
we must have to carry out our task is a battery of in- 
struments which measure understanding of mathe- 
matical concepts, and hence that ou r first step 
should be that of starting to construct a uc h instru- 
ments. 

CONCLUSION 

In conclusion, I should like to note that any frame- 
work we may construct for mathematics education 
may be quite specific and not immediately general- 
izable to other subject matter areas. In mathemat- 
ics we deal with only a very few aspects of the real 
world, namely the numerical and geometric aspects 
of physical situations. In science however, for ex- 
ample, many more different aspects of reality are 
considered, e.g. , life, energy, mass, acceleration, 
color, density, galaxies, elasticity, genetics, the 
periodic table. However, as a student progresses 
through the curriculum, his mathematical concepts 
are refined, sharpened, and generalized to a much 
greater extent than his scientific ones, so the result- 
ing mathematical conceptual structure differs mark- 
edly from his scientific one. Hence the process of 
concept formation in mathematics may oo t be t he 
same as In science, and problem-solving strategies 
may have quite different values In the two areas. 
And when we move to more remote curriculum 
areas, such as social science or literature, for ex- 
ample. the situation Is probably even more different. 
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DEVELOPING and testing new sci- 
ence programs for grades K through 12 liasbeen an 
activity of hundreds of university scientists and 
school teachers during che past ten years. The wide- 
spread and large-scale revolution in pre -college 
science reaching has been possible because large 
sums of money have been available from the Nation- 
al Science Foundation to finance the activities. The 
early curriculum reforms came at the high school 
level and. these are now well established in sc hool 
systems throughout the country. Because they are 
well known I will not elaborate on them, but It is im- 
portant to review them briefly because they have, 
in large measure, set the pattern for science cur- 
riculum research in the pre-high school grades. 

HIGH SCHOOL CURRICULUM RESEARCH 

These high- school curriculum projects did sev- 
eral important things. In the fir 8 1 place they 
stripped away the authoritarian discussions of mod- 
ern technological advances which had been tacked 
on to science courses that were twenty years or 
more out of date. They adopted the philosophy that 
teaching science was much more than teachingacat- 
alog of facts. Rather, it should be teaching facts 
together with concepts and developing at the same 
time ar. understanding of and an ability t o e ngage 
actively in the scientific enterprise. 

To accomplish these things the approach to teach- 
ing was radically changed. No longer w a s the dis- 
cipline presented in lecture and in text In didactic 
fashion No longer did the laboratory serve as a 
place where the student demonstrated to himself 
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facts already known. Instead, the laboratory has be- 
come the place where facts are learned through In- 
vestigation and the classroom the place where the 
results of laboratory investigations are discussed 
and an understanding of fundamental scientific con- 
cepts are developed. 

The Physical Science Study Committee (PSSC) 
led off the revolution in 19C6. This group decided 
to deal with physics as a unified story in which t h e 
successive topics would lead toward an atomic pic* 
ture of matter, and along with all this they hoped to 
develop the idea that physics is not a book completed 
or closed but is an unfinished and continuing activity. 
They designed new and simple laboratory equipment 
and devised new experiments so that th8 PSSC labor- 
atory became the place where students carried on In- 
vestigations, not simply demonstrations. 

In a similar way, the other high- school curricu- 
lum groups pointed their courses In new directions. 

The Chemical Bond Approach (C BA) project grew 
out of a conference of college scientists and hlgh- 
school teachers held In the summer of 19 57. Tho 
group noted that little change had takenplace In high- 
school chemistry courses for at least twenty years 
and that modern chemical concepts were little men- 
tioned and little used. The CBA group decided to 
make the most fundamental of all chemical concepts 
the central theme of the program. Hence, the Idea 
of chemical bonds has become the unifying thread of 
the curriculum. Chemistry is presented asan Inter- 
play of experiment and ideas - of what is observed 
and what Is thought. In the laboratory program the 
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students carry out small investigations, and In the 
classroom they learn to apply chemical concepts to 
explain their observations. 

The Chemical Education Materials Study (CHEM 
Study) also stresses observation and concepts. This 
study grew out of the recommendations of an ad hoc 
committee set up by the A meric an Chemical Society 
to consider needed changes in htgh-sr.hool chemis- 
try. The philosophy of the CHEM Study group U 
that the Important concepts and generalizations of 
chemistry should be developed inductively and that 
the evidence that the students use should be gathered 
by them in the laboratory wherever possible. Where 
this Is not possible it is presented by teacher dem- 
onstrations or films. There is emphasis on the uni- 
fying concepts in chemistry rather than on great vol- 
umes and varieties of technical applications. 

The Biological Sciences Curriculum Study (BSCS) 
of the American Institute of Biological Sciences 
faced some problems that were more touc hy than 
those faced by the phjsiclsts and chemists. Tradi- 
tionally, the topics of evolution and of human repro- 
duction had been taboo in high-schooi biology 
courses. The BSCS group felt that modern biology 
could not be taught without introducing these topics, 
and they, therefore, included them i n the three 
courses which they developed. Though the re has 
been some resistance to these controversial topics 
in a few places, there is now general acceptance of 
the new courses by schools throughout the country. 
Indeed, It Is estimated that this year 80 percent of 
all students talcing biology in the tenth grade are in 
one of the BSCS courses. Though the three BSCS 
programs take different approaches to the teaching 
of biology, the goals are the same - to present bi- 
ology as a dynamic and growing field of knowledge, 
not as an encyclopedic catalog of facts. A major 
accomplishment of the BSCS group has been to 
change the high- school biology laboratory from a 
place where dead, preserved s pec 1 me n s are dis- 
sected to a place where living organisms are exam- 
ined and experimented with, 

tn every case the curriculum groups saw to it 
that the materials were thoroughly tested In class- 
rooms before being released for general use. Each 
of the groups prepared batteries of tests to deter- 
mine whether high- school students could, indeed, 
learn science in these new ways. The results have 
been gratifying. 

One of the important accomplishments of a 1 1 of 
the curriculum groups has been to bring together 
scientists and teachers to work out th e new pro- 
grams. These are not c o ur se s ha nded to the 
schools by college professors, but are truly pro- 
grams that have been developed cooperatively. 

Physics has never beer, a popular subject for 
high- school students, and the Introduction of PSSC 
physics has not stimulated more students to study 
this discipline. There has been concern among sci- 
entists and educators that coJlegebound students, In 
general, should have some experience in this field. 
One group having this concern is developing anew 
high- school program which, it Is hoped, will encour- 
age non-science majors to take physics. The pro- 
gram, called Harvard Project Physics, adopts a 



cultural approach. It develops important concepts 
such as force, energy, and motion, but draws heav- 
ily on th^ hunnnisttc background of the science. 
The program Is still in an experimental stage, and 
It remains to be seen whether it will ac h i e ve its 
goal of increasing physics enrollment in high 
schools. 

The immediate short-range goals of the com- 
pleted hlgh-school curriculum projects seem to have 
been reached in a satisfactory manner. Through 
tryout and evaluation It is clear that high- school stu- 
dents can Learn science through the medium of the 
new programs. There are some a r * as, however, 
where further research remains to be done. Each 
of the curriculum groups either explicitly or implic- 
itly suggest that their approaches should develop in 
students an understanding of and an ability to engage 
in the scientific enterprise, and an Interest in and 
enthusiasm for science which should carry on be- 
yond the high- school years. Little has been done to 
determine whether the programs do indeed have this 
effect. A long-range study to evaluate this aspect 
of the new curriculum programs would be desirable. 

Another area which should be investigated is the 
effect of one program on another in a school. For 
example, one might ask whether a student In PSSC 
physic 8 in the twelfth grade does better if he has 
previously had BSCS biology and CBA or CHEM 
Study chemistry than if he has not. The AAAS Com- 
mission on Science Education has plans for carrying 
out such a study but the plans have not been imple- 
mented. 

A third and Important question is one of sequence 
of the courses in high school. The curriculum 
groups designed their programs to fit into existing 
slots: biology, tenth grade; chemistry, eleventh 
grade; and physics, twelfth grade. This sequence 
of courses has become established over several 
decades but there is no logical reason for teaching 
the courses in this order. Indeed, when one looks 
at the interrelationships of t he disciplines, logic 
suggests that the order should be Inverted. Modern 
chemistry is deeply rooted in physics, and modern 
biology requires of the student more than a speaking 
acquaintance with chemistry. The groups who pre- 
pared the chemistry and biology curricula recog- 
nized the problem. The chemists were forced to in- 
clude some of the ideas of physics - for example , 
the concept of energy - In their programs. The bi- 
ologists in turn, had to Include some simple chem- 
istry In the hope that students would better under- 
stand some of the molecular biology w h Ic h is in- 
cluded In the courses. The result In each case is 
not completely satisfactory, and It seems clear that 
some research needs to be done on this problem. I 
shall deal with this later. But now I want to turn to 
the pre-high school years and discuss the develop- 
ment of science curricula there. 

PRE-HIGH SCHOOL 

I said earlier that the new high- school science 
programs have set the pattern for science curricu- 
lum research in the pre-high school years. The pat- 
tern was set In several ways, including coooeration 
of scientists and teachers in producing the new pro- 
grams, and emphasis on s t ud ent activity and 
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and Investigation rather than on didactic preserva- 
tions, As the new high* school curricula came Into 
being, the writers and the teachers who used them 
soon realized that many of the skills and attitudes 
that students need for effective participation In the 
new curricula should be learned In earlier grades. 
Let me take just one example. The scientists work- 
ing with high- school teachers developlngCBAchem- 
Istry soon learned from the teachers that they could 
not assume that students entering hlgh-scfiool chem- 
istry had developed skills in constructing and Inter- 
preting graphs and so a section of the CBA program 
Is devoted to developing these abilities. There 
seems to be little doubt that these are skills that 
could be developed in earlier grades. 

Many of the scientists who worked on the high- 
school curricula are now devoting their energies, 
In collaboration with school teachers, fo designing 
and testing science curricula for the e ; rly grades. 
There are so many of these programs ior ele- 
mentary and junior high school that we cannot exam- 
ine them ail in detail. But we will review most of 
the major ones starting with the programs for the 
early grades and tellLng you in some detail about 
the elementary science program on which lam 
workLng. 

Each of the groups working at the e l e m e n t a ry 
school level have the same general philosophy and 
plan of attack. The purpose of Introducing new sci- 
ence pjograms into the early grades Is not so much 
to recruit more scientists as to prepare individuals 
to be scientifically Literate citizens. Literate not 
in the sense of knowing many scientif Lc f a c t s , but 
of understanding both the power and the limitations 
of science and its fundamental concepts. 

The approaches that the various curriculum de- 
velopment groups are taking to achieve this goal 
vary widely. The Elementary Science Study of Ed- 
ucational Services, Incorporated tak?s the position 
that the child should be intioducedtoscler.ee by pre- 
senting him with a variety of materials to i n ve sti- 
gate. They have develop ad and tested inclass- 
rooms, units on butterflies, gases and airs, kitchen 
physics, microgardening, meal worms, and many 
other topics. Let us Look at the meal worm unit a j 
an example. 

The children are given shoe boxes containing a 
few meal worms and are left to investigate them on 
their own. Gradually, as they otiserve them, they 
begin to ask questions. How do the meal worms 
find the edges of the box? How do they find their 
food? How do they back up? . . . and so on. As they 
design experiments to answer their questions, it is 
hoped that they will learn to evaluate evidence based 
on observation, classification, measurement, and 
control of variables; that they will learn toask ques- 
tions that they can answer by simple tests; and that, 
at the same time, they will develop a n enthusiasm 
for scientific investigation. 

The School Science Curriculum Project of the 
University of Illinois has a philosophy similar to 
that of ESS. 

The Science Curriculum Improvement Study at 
the University of California takes adifferent ap- 



proach. Its main thrust is todeveiop an understand- 
ing of science concepts starting inklndergartenwlth 
the simple concept of “What is an object?" and mov- 
ing from there to “What is a system?", “What is 
meant by interaction ?”, and so on. Their program 
is more structured than ESS but still leaves room 
for investigation by children. 

A science program for the early grades 1 g the 
Minnesota School Mathematics and Science group, 
abbreviated “Mlnnernast. " This group began by de- 
veloping a mathematics program and then devising 
science units to go along with it. Their science pro- 
gram alms at developing both sk^ls und concepts. 
So far they have seven units for kindergarten and 
first grade entitled “Watching and W ond er Lng , " 
“Describing and Classifying, ““Our Se»ises, M 
“Shape and Symmetry/’ “Objects and Their Prop- 
erties/’ “Changing and Unchanging Properties,” 
and “Introduction of Measurement. ,J 

The project with which I am working Is develop- 
ing a program, called Science - A Process A p- 
proach, for K through grade 6. This curriculum 
development is one ot the activities of the A A AS 
Commission on Science Education. Shortly after It 
was established in the spring of 1662, the A A AS 
Commission on Science Education held two confer- 
ences of scientists, science educators, and teach- 
ers. From these conferences came the suggestion 
that a fruitful approach to teaching science in the 
early grades would be to devise exercises which 
would develop children’s skills in using the proces- 
ses of science. The Commission elected to carry 
out this task. This program, which is now b e l n g 
tried out in schools for the third year, is, like the 
other projects, a cooperative effort of scientists 
and school teacheis. 

A basic premise of this project Is that a scien- 
tist’s behaviors as he engages in his pursuit consti- 
tute a complex set of skills and 1.. dlectual ac 1 1 v- 
itles but that these can be analyzed Into simpler ac- 
tivities, Ou'.d it Is these simpler activities which we 
are calling the processes of science. Another prem- 
ise Is that the individual’s ability to use these vari- 
ous processes can be developed in a step-wise fash- 
ion beginning in the earliest years of school. The 
processes for the early grades have been Identified 
as observing, classifying, measuring, communicat- 
ing, Inferring, predicting, recognizing and u s i n g 
space/time relationships, and recognizing and using 
number relationships. For each of the processes 
there Is a series of exercises of Inc re as lng complex- 
ity and difficulty wiich require the child to engage 
in activities in the classroom rather than to simply 
read or be told about science. 

Let me give you a better Idea of what the orogram 
is all about by describing in some detail o n e of the 
exercises written for the first grade, The exercise 
Is the fourth one in the Communicating process and 
Is entitled, “Introduction to Graphing. ” It stari.3 
with a statement of objectives - “Following this ex- 
ercise the child should be able to”: 

1. construct a bar graph. 

2. Identify and name the number of items repre- 
sented by the bars of such a graph. 

3. state the number of Items represented by the 
bars and distinguish between such express Ions 
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as moie than, fewer than, the same number 
i p, most, and fewest. 

There Is a section catted Rationale which tells the 
teacher why graphlnj is Introduced at this level. It 
gives her some suggestions about contacting ba r 
graphs and also includes suggestions of how to han- 
dle children’s questions about why a graph Isuseful 
in communicating Information. 

The activities are Introduced by putting into a 
box a number of colored blocks so that there will be 
one for each child and so that there will be at least 
three different colors. The teacher then asks each 
child to come and pick a block out of the box and then 
put It into a rough pile on the table so that the blocks 
of each color will be plied together. The teacher 
then asks the children Lf It Is easy to find how many 
blocks there are of each color. The children, of 
course, find it necessary to come up to the table 
and count the blocks In the piles. The teacher then 
asks If they can think of a way of arranging the 
blocks so that the number can be found more easilv 
and suggests, If the children dc not think of It, that 
If the blocks are piled in vertical columns, they can 
be counted easily even from a distance. Tnis leads 
ultimately to the question of ways of remembering 
bow many blocks there are of each color md into 
the next activity In which bar graphs are first Intro- 
duced. In that activity each child again selects a 
block and also a felt square and as he puts the block 
in one o # the piles on the table he puts the felt square 
In one of the columns on a felt board. At the end of 
this activity there Is a bar graph consisting of f e It 
squares on the felt board, one column for each col- 
or of block. In the activities that follow the chil- 
dren make bar graphs by coloring squares on large 
sheets of paper and finally are Introduced to the Idea 
of a grid and of labeling the vertical axis of the grid 
with numerals and the horizontal axis with a key to 
identify the objects. 

At the end of this exercise Is an Appraisal which 
the teacher uses to determine whether the children 
have developed the skills set forth in the objectives. 
For the Appraisal the children are given objects 
such as toy vehicles of various sorts and asked to 
irate graphs to indicate how many of each type there 
are and then to answer questions the teacher poses 
about the graph - questions such as: Are there 
fewer cars than motorcycles? Are there more 
trucks than motorcycles? 

You will have noted that one of the processes that 
I mentioned is recognizing and using number r e la- 
tions. While there were some of the writers who 
felt that It was not necessary to Include number ex- 
ercises In a science program, the majority agreed 
that since number skills are required In many of the 
other process exercises, we should not simply as- 
sume that the child learned them in his regular 
mathematics program. The exercises in the num- 
bers process are not Intended to be a complete math- 
ematics program but are Intended to supplement the 
program already in use in the classroom, 

At the fourth grade we begin to shift gears and 
introduce anew set of processes which are more 
clearly recognizable as activities that a scientist 
engages In. These processes are formulating hy- 
potheses, controlling variables, experimenting, In- 



terpreting data, da vising models, and making oper- 
ational definitions. We sometimes speak of these 
as the integrated processes because they bring to- 
gether the skills from the earlier part of the pro- 
gram. 

One of the advantages of a program in which the 
objectives are stated In behavbrsl terms is that 
evaluation can be done by assigning the children 
tasks which will indicate whether or not they have 
attained the expected sklll3. For example, follow- 
ing the kindergarten exercise In which the children 
learn to identify and to name various plane shapes, 
such as circles, squares, triangles, and rectangles, 
it Is a simple matter for the teacher to present a 
child with an array of plane shapes and ask him to 
point to a triangle, or the teacher might point to a 
circle and ask the child to name it. The results of 
each task can be recorded with a binary scale. Yes, 
the child could perform the task, or no, he could not. 
For each exercise we have prepared a series of 
tasks which we call the competency measure. Each 
teacher in our tryout program uses the competency 
measures on a sample of children from her class 
after she has taught each of the exercises. The re- 
sults of this testing in the various tryout centers 
are collected and tabulated and used by the writers 
as they revise the exercises during each summer 
writing session. The results give the wr ite r s a 
good Idea about the success or failure cf any given 
exercise. 

There ".re many aspects of the teaching in the 
classroom that we cannot learn about through the 
competency measure and so we ask each teacher to 
give her subjective impression of the exercise on a 
feedback form. This Includes information about the 
time required to carry out the instruction, sugges- 
tions of activities that might ba omitted or added, 
the reaction of the class, including Interest and en- 
thusiasm, carry over of learning to other activities 
or areas, and attention span. This feedback is also 
helpful to the writing group as the program is re- 
vised. 

Although the emphasis in Science - AProcess 
Approach Is on developing skills Ln using science 
processes it is important to ask the question, “What 
about science content?” it is obviously impossible 
to teach process skills without using content of 
some sort, and the content that we use is drawn 
from various fields of science. To Insure this we 
include in our writing team scientists from all ma 
joi areas. In the early grades, of course, there 
are many exercises Ln which the relationship of the 
content to science appears to be somewhat distant 
Learning to recognize p. name two- dimensional 
and three-dimensional shapes Is an example. Learn- 
ing to make graphs using colored blocks is another. 
However, as the program progresses Into higher 
grades the content Is more and more clearly sci- 
ence. For example, among the twenty-five ex e r - 
clses in Part Five, which is used In fourth grade, 
are the following: 

Inferring 8 - Inferences of Patterns Ln Electric 
Circuits 

Defining Operationally 1 - Circuits, Conductors, 
and Nonconductors 

Controlling Variables 1- Growth of Mold on 
Bread 
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Interpreting Data 1 - Guinea Pig Learning in a 
Maze 

Controlling Variables 7 - Orientation of Plants 

Experimenting 1 - Separating Mixtures 
Of the elghty-one exercises in Parts Five, Six, and 
Seven, the subject matter is approximately as fol- 
lows: physics 33 percent; biology 21 percent; math- 
ematics 17 percent; chemistry 9 percent; psychol- 
ogy and social science 9 percent; earth science 7 
percent; astronomy 4 percent, 

JUNIOR HIGH SCHOOL 

We believe , then, that by the end of the s Lxth 
grade, children going through this program will not 
only have developed sufficient skills to carry out 
simple Investigations but also will have a store of 
scientific knowledge which will make It possible for 
them to embark on a fairly sophisticated gc le nc e 
program in the Junior- high- school years. What the 
pattern for Junior -high- school science will turn out 
to be Is not yet clear. At the moment t he r e are 
four groups who have developed curriculum materi- 
als for Junior high school ar.d tested them on a fairly 
wide scale. Then there are several other groups 
who are at earlier stages of curriculum de ve lo p- 
ment. The four programs that are farthest along 
are centered mainly in the physical and earth sci- 
ences ar.d astronomy. 

The astronomy program, known as the University 
of Illinois Elementary School Science Project, ac- 
tuary is designed for the later elementary grades 
and the early Junior -high- school grades. This pro- 
gram is frankly subject matter oriented and con- 
sists of a series of childrens’ books and teachers’ 
guides. The program starts with the topic “Chart- 
ing the Universe, ” which Includes measuring dis- 
tances in the solar system, measuring the size and 
shape of the earth, and using light as a tool for meas- 
uring great distances. The topics which fo Uow It 
are “The Universe In Motion,” “ Gravitation, ” and 
“The Message of Starlight. " Two additional topics 
which are still in preparation are “The Life Story 
of a Star” and “Galaxies and the Universe. ” These 
materials are not intended to serve as a complete 
science program fur grades five through eight, but 
rather as topics to be Included In a broader science 
program. The materials are being tested by sev- 
eral hundred teachers In various parts of the coun- 
try but the results of the evaluation have not been 
reported 

The second program which includes some as- 
tronomy but many other topics as well, Is the Earth 
Science Curriculum Project wUch is designed for 
ninth grade. This course was first written by a 
team of scientists and teachers In the summer of 
1964, revised In the summer of 1965, and is already 
being prepared for commercial publication. The 
course, called Investigating the Earth, is an experi- 
ence-centered course In which Inquiry in the study 
of natural phenomena is stressed. It consists of 
four units - the first one, “The Dynamic E ar t h, ” 
considers tho materials of the earth, earth changes, 
earth motions, force fields, and energy flow In 
earth processes, The second unit, “EarthCycles,” 
considers the hydrologic cycle, climate, and the 
earth’s crust. The third unit, “The Earth’s Past,” 
discusses the measurement of geologic time and 



paleobiology. Tho course ends w 1th a fourth ur Lt, 
“Earth and the Universe, ” which begins with a dis- 
cussion of the moou, moves on to the solar system 
and Us origin, pnd finally to stars, galaxies, and 
cosmology. The program has been e va Luat e d in 
eighty ctassrooms, and student progress has been 
determined with a test on science knowledge which 
Is used both as a pre- and posttest. 

A third Junior- high- school program - Time, 
Space, and Matter - is being developed by the Sec- 
ondary School Science Project at Princeton Univer- 
sity. This program begins and ends In geology but 
includes a good deal of fundamental physical science 
as well. The students Investigate topics such as 
solution, crystallization, and water erosion using 
well-designed equplment which is fuwdshed to them 
In the form of Individual kits. 

A good deal of attention is being given to eval- 
uating this program to provide feedback for those 
who are revising the course. Each teacher keeps a 
dally record of course progress and reports at reg- 
ular Intervals to the project office. The teachers 
are particularly requested to Indicate where stu- 
dents shov* an extension of knowledge or interest to 
out-of-class situations and where they show signs 
of understanding or of confusion as t h oy use the 
course materials. In addition, the group is develop- 
ing a test to demonstrate changes in the behavior of 
children after they have had experience with the new 
curriculum. Other methods of evaluation, including 
the instructional Interview technique, are being con- 
sidered. 

A fourth program, called Introductory Physical 
Science, Is being developed by the same group that 
prxluced the high- school PSSC physics course. This 
course also Is Intended for ninth grade and Is de- 
signed to develop In the students basic attitudes and 
skills that they will need when they later encounter 
the new hlgh-school programs in physics, chemistry, 
and biology. The first two-thirds of the courso con- 
siders matter and Its properties and Leads to the 
need to assume that matter is particulate in nature. 
The last third of the course considers the size of 
molecules, molecular motion, and energy. This 
course ie laboratory centered, and the group has 
devised simple equipment which permits students to 
carry on significant experiments Inordinary class- 
room?. 

It lo clear as one looks at the new developments 
In science curricula for the Junior high school that 
we are a long way from a smooth flowing science 
curriculum for these grades. There has been little 
or no coordination among the present curriculum de- 
velopment projects. As a first step toward cooidt- 
natlon the AAAS Commission on Science called a 
conference of representatives of the Junior- hlgh- 
scbool curriculum projects In science and mathe- 
matics. The conference was held In July 1965 at 
Michigan State University. As the representatives 
of the projects reported on their work it became 
clear that there was a majer gap In the Junior-high- 
school curriculum developments. No group was 
working In the field of biology. The Biological Sci- 
ences Curriculum Study has, for some time, been 
planning to develop a biology program for Junior 
high school, but they have made no progress since 
funds have not been made available to them. 
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At the conference, Bentley Glass and Arno lu 
Grobman ol BSCS suggested two possible ty pe s of 
junior- high- school science programs. One Is a top- 
ical plan and the other a stratified plan. In the top- 
ical pHn they suggested that the science program 
for grade 7 Include about half a dozer, topics, such 
as conservation of n atter and energy, natural cy- 
cles. biological regulation, and homeostasis. An- 
other half dozen topics would be developed for eighth 
grade. These would Include change through time - 
cosmological, geological, and biological. Another 
^roup of topics would be developed for nlnlh grade 
and would Include the broad aspects of meteorology, 
environment, and habitat. 

The stratified plan that they suggested was as 
follows: 

Grade 7 - physical science - a year course In 
descriptive aspects, largely earth sciences. 

Grade 8 - life science - a year course in diver- 
sity and unity In the organic world, fundamen- 
tal structure and function. 

Grade 9 - physical science - a year course In 
basic concepts of matter and energy. 

Another possible approach to an Integrated jun- 
ior-high- school science program was described at 
the conference by Dr. Robert Jastrow, chairman of 
the Junior High School Science Subcommittee of the 
AAAS Commission on Science Educai'^n. This pro- 
gram would follow naturally from t».t elementary 
program, Science - A Process Approach, but could 
also build on the other elementary science programs 
that l have already described. The course for sev- 
er th grade would serve as a transition between an 
elementary science rogram where the student has 
developed skills in using science processes and 
where he has Earned some basic science content; 
and the eight and ninth grades in which the course 
would develoi * coherent picture of man and his 
physical and biological cnvlionment. The seventh- 
grade course, which would be rooted In laboratory 
experiences and field trips, would consist of selec- 
ted topics from the physics’, and biological sciences 
and from astronomy and the earth sciences. 

The eighth grade would begin with consideration 
of the basic materials and forces of the universe. 
The neutron, proton, and electron as fundamental 
units out of which all matter is constructed, and the 
basic forces of nature - gravity, electromagnetism, 
and tho nuclear forces. The Interplay of particles 
and forces would then be used in the discussion 
of the birth of stars and galaxies and the synthesis 
of chemical elements. The next seep would be to 
consider current ideas about the formation of the 
solar system, nature of planets, and the probability 
that planets exist around other stars. Then geophys- 
ics and geology would be introduced in a discussion 
of the history and present structure oftheearlhand 
Its atmosphere, and finally the course would take 
up the elements of molecular biology and combine 
this recently acquired biological knowledge with the 
geological discussion of the earth’s history In broad 
attack on the problems of the origin of 1 if e and the 
biochemical foundations of evolution. 

The ninth-grade course would treat biology from 
the point of view of evolution. The first topic to bt 
considered would be the development of se If repli- 



cating cells from primitive catalysts and complex 
organic chemical systems. Then multicellular or- 
ganisms would be discussed and the similarities be- 
tween plant and animal forms as far as capture, stor- 
age, and step-wise release of energy Is concerned. 
Following this, differentiation and embryo genesis 
would be considered and then the molecular, organ- 
ismlc, and ecological factors involved In natural 
selection would be treated. The ninth- grade pio- 
gram would end with a discussion of *he development 
of the nervous system and with how the nervous sys- 
tem accounts for ccnsc lout ness, f^rceptlor., learn- 
ing, and memory. 

A course of this sort, In which central problems 
of modern science serve as the core, should serve 
as a general education course for students who do 
not elect to take much science In high school. At 
the same time, it should provide a solid background 
of the skills and understanding which wo u Id serve 
as an effective base for the Mgh school biology, 
chemistry, and physics courses. No work beyond 
planning has been done on this program yet. It I s 
hoped that work can begin within the next ye-ir. 

SCIENCE COURSE SEQUENCE 

Now I want to come back to the question about the 
sequence of science courses in high school that I 
have already mentioned briefly. One of the argu- 
ments for putting physics off until the twelfth grade 
is that the students do not develop the necessary 
mathematical skills until they have reached that lev- 
el. I have not said anything about the new math- 
ematics curricula except the relationship of mathe- 
matics to the Science - A Process Approach ele- 
mentary curriculum. There are, of course, sev- 
eral pew approaches to teaching mathematics In the 
schools, bi these new programs the students devel- 
op mathematical skills at much earlier grade levels 
than they have done In the older traditional pro- 
grams. It is possible, I think, that by the end of 
the ninth grade, students will have sufficient skill 
In algebra to do the mathematics tr* a modern phys- 
ics course such as PSSC. Mathematics skill would, 
therefore, no longer be a block to moving physics to 
an earlier grade. 

If a Junior- high- sc hooi sclencecurrlculum gives 
the student some 'undamental knowledge of physics, 
chemistry, and biology and related sciences, I see 
no reason why physics cannot be made a tenth-grade 
course, followed by chemistry In grade 11, and a 
molecular biology course in grade 12. Already, In 
a number of school systems arouna the country this 
sequence is being tried. 

There Is another possible pattern for grades 10 
and II. Since there ?re a number of topics that are 
common to physics aid chemistry, it is possible to 
interweave these two disciplines Into a two-year se- 
quence of physical science. An experiment Is now 
under way In Portland, Oregon, to do just this, A 
group there set out three years ago todevlse a “road 
map” through PSSC physics and CBA chemistry and 
a similar one through PSSC physics and CHEM 
Study chemistry so that teachers could move easily 
from one book to the other. The program starts 
with the topic “Interpreting the Universe, “and con- 
siders f undamf r’al concepts and measurements and 
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the rxature of chemical change. The next section Is 
mechanics which is all drawn from the PSSC course. 
The rest ol the year is devoted to the electrical na- 
ture of matter, atomic models, and molecules and 
energy. In all of these chemistry and physics are 
interwoven. In the second year of the program there 
is less blending of the two subjects. The course be- 
gins with optics and waves, followed by electromag- 
netics and a discussion of quantum systems and then 
moves Into consideration ol bonds and chemical sys- 
tems; order, disorder, and change; and molecules 
and energy. 

This program has been evaluated using selected 
test Items from CBA, CHEM Study, and PSSC tests, 
The Portland group reports that the combined pro- 
gram Is successful and that even though students 
are permitted to take only the first year if they like, 
a large majority of them stay with it for the full two 
years. At present, this program Is designed Cor 
grades 11 and 12, but it could be used at grades 10 
and 11. 

The “road map” technique is not completely sat- 
isfactory, and there is need fo^ a fresh start to de- 
velop an Integrated modern physical science curric- 
ulum. 

REVIEW OF PROBLEMS 

We have examined some of the recent and current 
science curriculum research and have suggested di- 
rections In which curriculum research might go in 
the future. There are some corollary p obi* ms 
that I have omitted, We will review these briefly. 

As elementary science education move s from 
fairly passive learning through books and exposition 
to student manipulation and investigation, there will 
be an Increasing need to provide supplies and equip- 
ment for classrooms even as early as kindergarten. 
The amount of money provided for science supplies 
In most school systems is small. It will have to be 
increased manyfold to accommodate the new pro- 
grams. It is impossible to do more than estimate 
roughly what the cost of introducing the new elemen- 
tary programs would be. It appears that on the or- 
der of $200 per classroom will be needed to intro- 
duce the new programs. To assist school systems 
in planning for the introduction of the new elementary 
science programs, the AAAS CommlsslononSclence 
Education is just embarking on a study of the costs 
of equipment and supplies. It is our expectation 
that this study will be completed shortly. 



Classroom design will also be influenced by the 
new science curricula. As a minimum (or the early 
grades, classrooms should have multiple electrical 
outlets, running water, and level working areas. I 
have been surprised at the many classrooms I have 
visited that have only a single electrical outlet. 

Although tho new junior- high- school science cur- 
ricula that are now under development are designed 
to be used In classrooms without special laboratory 
facilities, I think that in the I ut»* r e Junlor-htgh- 
school classrooms will need to be provided with 
Laboratory space similar tothat found In senior high 
schools. 

A crucial problem raised by the new curricula Is 
teacher training. As you know, the se n lor - h Lgh- 
school science teachers have been able to a 1 1 e n d 
summer Institutes to learn to use the new biology, 
chemistry, and physics courses. A few Institutes 
are now being held for junior -high- school science 
teachers. For the elementary schools the problem 
is different both quantitatively andqualltatively. The 
science programs for the earliest grades do not re- 
quire that the teacher know a great deal of science 
content, but they do require some teacher orienta- 
tion. Up to now during the experimental stage the 
various curriculum groups have carried on this or- 
ientation and training on an ad hoc basis. In the fu- 
ture, as the programs are more widely used, school 
systems must establish Inservice training programs. 
It would seem that high- school science teachers 
might bo used to staff such programs. 

And then theie is tne problem of preservice 
training of teachers. Only one of the curriculum 
groups, “Mlnnemast, ” is preparing college mate- 
rial to train prospective teachers to use the “Mlnn- 
emast” materials. There is a group at Rensselaer 
Polytechnic Institute that Is designing a new course 
in physical science for non-science majors with the 
thought that this course will better prepare new 
teachers to use the new school science curricula. 

I said earlier that one of the important things 
that happened as the curriculum groups organized 
and developed their programs was that scientists 
and teachers collaborated, each learning from and 
educating the other. This cooperation has produced 
needed and significant changes in science curricula. 
Changes which could not have been elfectedby either 
scientists alone or teachers alone. This coopera- 
tion must, and I am sure, will, continue. Science 
curriculum research is a continuing activity, and the 
best minds in science and the best minds in educa- 
tion must be devoted to .t. 
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THIS PAPER is planned to pr e se n t 
selected Items of recent research In the teaching of 
English from a number of aspects. Together they 
make up the body of Information a.td expert opinion 
which will largely direct curriculum work In the 
decades ahead. Although the goal of most English 
teaching Is to accomplish an Integration of the com- 
ponent parts of the subject, they are here presented 
tn divisions to avoid confusion and overlap. One 
area of research and study often associated with the 
English language arts is reading as a s k i 1 1 . It Is 
omitted from the survey because In the field erf edu- 
cation it is considered separate from the language 
arts. It has Us own courses, Its own faculties, and 
a very extensive body of research, only a small por- 
tion of which Is related to the language arts. The 
word "research” has been interpreted broadly 
enough to include mention of seminal books which, 
If not In themselves research, have /nduced and will 
Induce research In the areas of their Ireatments. 

THE PROFESSION 
OF ENGLISH TEACHING 

In 1961 a committee of the National C ounc 1 1 of 
Teachers of English published a document entitled 
The National Interest and the Teaching of E n g 1 i s h 
with the sub-title A Report on the Status of the Pro- 
fession . In three major parts this document studied 
the present situation In the teaching of English, re- 
lated the situation to the national scene, and made 
analyses and studies leading to specific recommen- 
dations for the improvement of the teaching of Eng- 
lish by meeting recognized needs. 



The scope of the responsibility of English Isdram- 
atized by a bar chart revealing that of all h Igh 
school students In school Lu I960, 92. 9 percent were 
enrolled in English courses, 68 percent in social 
sciences, 55 percent in mathematics, and 25 percent 
in fcrelgn languages. A turvey revealed that L* the 
years 1958-1959 the dem arid fur trained high- school 
teachers outran the supply by 27 percent. Ex pand- 
ing school populations will Increase this ratio . 
Moreover, the expansion of knowledge 2nd the re- 
quirements of a complex society will increasligly 
demand more technlcaltralnlng and know ledge on »he 
part of English teachers than was true in the pa st . 
The single greatest weakness In the current situa- 
tion is the lack of articulation in the teaching of Eng- 
lish from the elementary school through college. 

A summary of the highlights of the status report 
follows: 

The Need for Teachers of English: 

a. The shortage of teachers shows no sign of 
decreasing. 

b. One-fourth of all elementary teachers are 
not college graduates. 

c. Only 40 to 60 percent of high -school Eng- 
lish teachers have completed a college ma- 
jor in English. 

d. There is an acute shortage of college in- 
structors in linguistics and composition. 

State Certification Laws: 

a. States differ widely in requirements. 

b. Ten states certify elementary teachers 
without a degree. 

c. Nineteen states have rvo stated requirement 
In English tor elementary teachers; twenty- 
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one lack definite requirements In reading, 
children's literature, and English methods, 
d. Minimum preparation In English for Eng- 
lish teachers is sixteen to eighteen credit 
hours. 

Preparation ot elementary teachers: 

a More than 04 percent of the colleges fall 
to require specific study of the English 
language, 

b. Leflft than half require a course In the teach- 
ing of the ’angiage arts. 

Preparation of secondary -school teachers of Eng- 
lish: 

a, Only one-fourth of the colleges require a 
coarse In the history of the English tang- 
le. 

h. Only 17 percent require a course in Modern 
English Grammar. 

c. Only 41 percent require a course in ad- 
vanced composition. 

0. Only slightly more than half the colleges 
require a course in the method e of teaching 
English. 

Better Teaching Conditions: 

Teachers with a student load of 150 (five sec- 
tions of thirty students) must work mo re 
than 50 hours a week just meeting classes 
and marking papers. (In 529 out of 682 
schools, English teacher shad five classes. ) 

Libraries: 

a. 10, 000, 000 elementary, and about 150,000 
high-schooi students attend schools lacking 
a central library. 

b. The average expenditure for books per stu- 
dent is about half the price of one average 
book. 

Remedial English in Colleges: 

a. An estimated 150, 000 students failed college 
English tests In I960. 

b. Two-thirds of American colleges ha v e to 
offer 'remedial work In English. 

c. The cost of remedial instruction i 8 esti- 
mated to be over ten million dollars. 

A continuation of the research into the status of 
Uio teaching of English was carried on by a commit- 
tee of the National Council of Teachers of English 
and published In 1964 under the title The National 
Interest and the Continuing Education of Teachers 
of English . The principal purpose of this investiga- 
tion was to discover and reveal the need for inserv- 
ice education of teachers concerned with English In 
elementary and secondary schools. Questionnaires 
were answered by 7, 417 secondary- sc tool English 
teachers and by 3,030 elementary- sc tool teachers. 

Some hlgh*lght8 of the analysis are: 

1. Over 40 percent of the nation's elementary 
teachers began full-tlmo teaching without a 
degree. Only 31 percent of these achieved the 
degree after beginning teaching. 

2. More than one in ten high- sc tool teachers 
(11. 6 percent) began full-time teaching w ith- 
out a degree. Practically all of these earned 
a degree later. 

3. Although 24 percent of Instructional time In 
kindergarten through grade 12 is givento Eng- 
lish and language arts, only 8 percent of the 
elemerUuv teachers* college preparation is 
given to tnis 8'ibject 



4. About half (49. 5 percent) of secondary teach- 
ers teaching Engl.'sh lack a major in this sub- 
ject. 

5. By their own admission only 51. 0 percent of 
secondary- school English teichers feel com- 
petent In literature; 36. 6 percent feel compe- 
tent in composition, and 53. 5 percentfeelcom- 
petent to teach the English language. 

6. In voluntary continuing education, elementary 
teachers take one tummei session for each 
eight years of exper lence. But the courses 
taken are largely In education, with little or 
no further education in the language arts. 

7. Thirty percent of peccndcry teachers of Eng- 
lish have not taken a course in English in more 
than ten years. 

8. Interest in further education for elementary 
teachers was expressed for six areas: c h il- 
dren's literature, language, speech, writing, 
general literature, and the largest number, 
7P. 1 percent In reading. 

9. Secondary teachers expressed Interest in fur- 
ther experience in practical methods of teach- 
ing English: intermediate or advanced compo- 
sition, literature for adolescent f teaching of 
reading, literary criticism, and structural 
aiui/or generative grammar. 

The broad conclusion is overwhelm' ng evidence 
of inadequate training with a clear need for means 
to make inservice fuilher education available to 
nearly all teachers of the English language arts. 

Two books of Importance to the whole profession 
of the teaching on Engliph appeared in 1963 and 1965 
respectively. The Education of Teachers of English 
(Gromme% 196?' T s Volume V of a curriculum se - 
ries of the National Council of Teachers of English. 
Written by a committee representing elementary- 
school, high-setool, and college English teaching, 
it analyzes facts, Implications, and Inferences In 
such nutters as the liberal education of t e a c h e rs, 
the professional education of English teachers, and 
the specific preparation in English itself. It con- 
firms the conclusions reached In other studies that 
eh ?ntary- school teachers are very poorly pre- 
pared to teach English; that the preparation of hlgh- 
schoo! teachero is subject to wide variations and 
some serious omissions; and that college teachers, 
though perhaps well grounded in content, are often 
innocent of any preparation to teach. Much space 
is devoted to recommendations and procedures for 
the continuing education of teachers by means of sum- 
mer sessions, Institutes, evening classes, and usee 
of mass media. 

The second broad area book is Freedom and Dis - 
cipline In English , a report of the Commission on 
English of the College Entrance Examination Board 
(1965). The Commission on English was appointed 
in September 1959, Consisting of sixteen members 
from universities, colleges, and private schools, it 
undertook to deflnj the field of English, and to set 
standards for Instruction In English and In the prep- 
aration of teachers for English. In 1962 It sponsored 
and supported twpnty institutes attended by 86 8 teach- 
ers In all parts of the United States, It c om mis- 
sioned and issued a series of kin escopes featuring ex- 
perienced college teachers of English expounding 
their specialties. These kinescopes are lent free of 



I 



58 RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 



charge except for mailing costs. The volume Free - 
dom and Discipline in English Is the final report of 
the Commission. 

Chief contributions to the curriculum axe; 

1. Recommendations to improve the quality of 
instruction. 

2. An analysis of Language teaching, Including 
grammar and usage. 

3. An analysis of Literature teaching, emphasiz- 
ing the critical process in teaching and study- 
ing literature. 

4. Ar analysis of composition, Including valua- 
ble suggestions for m. “vating writing, and for 
the correction, criticism, and measurement 
o! writing skill. 

Without essential conflict in fundamental matters, 
It may be stated that, In general, the publications 
of the National Council of Teachers of English tend 
to be experimental and progressive in outlook, and 
that the point of view of the Commission on English 
is conservative. To the curriculum director there 
Is great value K the balance to be d e r I v e d from 
these differing viewpoints. 

RESEARCH IN THE 
TEACHING OF LITERATURE 

Although most of the studies in literature deal 
with Ideas and values rather than with C0i. troll e<5 
evaluation, some recent studies reveal effec t ive 
techniques for measuring the success of students in 
the learning of kinds of literary materials. Squire 
(1983) studied the responses of adolescent readers 
to four short stories, establishing their responses 
as forming seven categories: I. Lit erary Judg- 
i r^nts: Direct or implied judgments on the 6tory as 
pji artistic work; n. Interpretati ons! Responses: 
Reactions Ir which the reader generalizes and at- 
tempts to discover meaning, motivation, and the na- 
ture of the characters; HI. Narratlonal Responses : 
Reporting facts or details from the story without In- 
terpretation; IV. Asr relational Responses: Re- 
sponses In which the reader associates Ideas, 
events, places, or people with his own experience; 
V. Sell -Involvement : Responses In which the read- 
er associate/* himself with the behavior and/or emo- 
tions of the characters; VI. Prescriptive Judgments : 
Responses In which the reader prescribes a courf e 
of action based on some absolute standard; VII. Mis - 
cellaneous Responses: all others. 

Wilson (1966) reports the responses of c olle ge 
freshmen to the reading of three novels: The Catch- 
er In the Rye (Salinger), The Grapes of Wrath 
^Ste Inbeck), and A Farewell to Arms (HemlngwayY. 
Fifty- four freshman Engl5sh students read a novel, 
took notes while reading, and wrote Immediate re- 
actions In cHsa. After three discussion periods 
they wrote follow-up reactions. This procedure was 
followed for each of the three novels. 

The written responses were coded by means of 
Squire's (1963) categories. Statistical analysis 
showed that 65. 6 percent of responses to the three 
novels were later pr e tat lonal; 12. 2 percent literary 
judgment ; self Involveme nt. 8. 9 percent; narratlon - 
al f 8. 7 percent; assoc lat ion al 2. 1 percent; pre- 
scriptive 1. 3 percent; mi scellaneous 1. 3 percent. 



The lead of i nterpretation over l iterary judgment i*r 
a sign of maturity of perception; it suggests that 
teachers should avoid supplying “correct” inter pre* 
tations before the book Is read by the student. The 
study reveals that although students may begin their 
involvement with literature In a groping and emotion- 
al fashion, their later attempts at interpretation be- 
come sharply formulated and logical. Teachers 
should therefore refra'n from demanding that first 
reactions be fully described or defended. But as the 
study of the novel moves into the grappling with dif- 
ficulties, the Instructor should demand expert anal- 
ysis. Most students are capable of growth of inter- 
pretation by these means. 

The Research Foundation of the National Council 
of Teachers of E^gllfh is sponsoring, directing, and 
supporting research In children's growth Insensitiv- 
ity to, and appreciation of literature. Starting with 
a national conference of elenentary- school, high- 
school, and college specialists *n literature assem- 
bled in Chicago In May 1G63, the Foundation applied 
itself to research in the teaching of 1 i t e r a t u r e be- 
cause so little is being done. It was soondiscoi ered 
ihat there were no !*'?*ruments available to measure 
any aspect of success in children's growth In litera- 
ture. The Foundation then determined to try to cre- 
ate such tests, both as research In itself, and as the 
means to further studies. Following consultations 
with various authorities, the Foundation appointed 
Margaret Early of Syracuse University the Director 
of the test activity and appropriated funds In Its sup- 
port. In the summer of 1965, Early assembled at 
Champaign, Illinois, some twenty-five selected 
teachers and librarians to develop test items. From 
the materials produced by tnis group, and augmented 
by Early’s advisors, four forms of a test have been 
developed by cooperative work with the Educational 
Testing Service ox Princeton, New Jersey. A trial 
run was made of these forms in the spring of 1967 at 
elementary schools in grade 5 In locations covering 
the United States. From the statistical study of the 
returns It is e v pected that two final forms of the test 
will be developed. 

The goal is to attempt to discover growth In the 
responses of children to literary experiences. The 
range is from grade 4 to grade 6, inclusive. Al- 
though It will be a pen and paper test, many of the 
Items will he presented orally on tapes. If the test 
reveals measurable growth In responses to litera- 
ture, the research will continue in two directions: 
(1) to measure the effectiveness of kinds of instruc- 
tion on the literary growth of children; and (2) to 
creale similar tectB for junior- high schools and pos- 
sibly senior-high tchools. 

RESEARCH IN THE 
TEACHING OF COMPOSITION 

One of the most exhaustive researches of recent 
times was conducted by Richard Braddcck, Richard 
Lloyd Jones, and Lowell Schoer of the University 
of Iowa and p:bllshed in 1963 by the NOTE under the 
title Research In Written Composition. It undertook 
io assess all known research in compos Itlon that 
could be described as “scientific. " From twenty 
bibliographies of research came over a thousand ci- 
tations; committee analysis reduced these to 485 
Items. From consultation with seventeen authorities 
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this number was reduced to about one hundred titles; 
later some fifty other lltles were added. Afor vig- 
orous analysis, only five studies survived the crite- 
ria set up by the Investigators. These five only, In 
the eyes of the Investigators, can be termed valid 
In the teaching of composition. 

1. The Baxto n study revealed that thorough crit- 
icism of composition by a competent reader, fol- 
lowed by revision by Ihe student brought better gains 
than writing not criticized. 

2. The Harris sludy showed In a 2-year spac e 
that the direct (or functional) teaching of grammar 
brought better results than the formal, analytical 
method. 

3. The Kinca id study undertook to reveal whether 
a single paper written by a student on a given topic 
at a particular time provided a valid means to judge 
a student's writing ability. Joined to this question 
were several others, so that clear answers were 
almost Impossible to secure because of weakness In 
the structure of the research. 

4. The Smith study dealt with class size asafac- 
tor in the teaching of writing. It revealed that a 
large class of superior rinth-grade students can 
pregress in composition as well as a small class. 

5. The Decker study compared three methods of 
teaching, described as normal, bibliographic, and 
kinescope melhods. The so-called normal mellod 
was found to have a slight superiority over the 
otherc. 

The conclusion of the Braddock Investigations is 
that of the more than a thousand Items originally 
noted, only these five may be considered to yield 
valid answers from sound rest rch. 

In a review of the Braddock report In College 
English, Jean Kagstrom (1964) analytes the re- 
search methods employed in these the researches, 
and concludes, "ft Is therefore extremely disheart- 
ening to say that 1) none of them strikes a layman 
as definitive or persuasive, and 2) there is very lit- 
tle promise that without rigorous antecedent thought, 
the ‘scientific* method applied to composition will 
yield better results in the future than It h a s In the 
past. " He urges antecedent thought on such ksslc 
problems as: How do you find a subject? How do 
you ck/he It In sppropriste style? Hr* d j you give 
it effective organization? 

The Research Fov~datk>o of the National Council 
of Teachers of English planned a 1967 conference of 
specialists tr e number of Melds to Attempt to iden- 
tify the fundamental* of composition. 

Current research tr, composition has taken an In- 
teresting and profitable direction In applying statu - 
tkal procedures to rhetoric. Kellogg W. Hunt 
(1965a, 1965b) collected luge samples o # students' 
writing st grsdes 4, 8, and 12. These were Subjec- 
ted to structural analysis to Attempt to describe the 
differences In sentence structure as studenU mature. 
As a tool of analysis Hunt developed what be called 
the "T-unlt": a group of words minimal in length, 
each terminated grammatically between a c a p II al 



letter and a period. This unit has the advantage of 
preserving all of the subordination achieved by a stu- 
dent, and all of his coordination between words and 
phrases and subordinate clauses. 

His findings, very much condensed , are shown 
In Table 1. This table reveals that the most signif- 
icant mark of maturity in w r it In g is not sentence 
length In Itself, but the increase of length of the T- 
units. When superior adults writing for Harpers 
and the Atlantic Monthl y were analyzed by the same 
means, the length of their T- units increased by 40 
percent over the twelfth graders’, an Increase equal 
to the gain of twelfth graders over fourth graders. 
Twelfth-grade students came close to the profes- 
sionals in the number of c 1 au se s they use; the 
growth among professionals It in the increased num- 
ber of words per clause. These results giveaclear 
indication of the factors lobe studied and taught In 
the improvement of sentence structure. 

Francis Chrlsivnsen 0963b) counted s ente rc e 
openers to provide objective knowledge of how pro- 
fessionals oegln sentences. High- school and college 
composition teachers have generally encouraged a 
wide variety of sentence openets, including prepo- 
sitional phrases of all types, participial phrases, 
gerund phrases, absolute constructions, and sen- 
tence Inversions. Cr.e writer says, "When a stu- 
dent opens a sentence with an Infinitive phrase or a 
post participle, we Immediately stamp him as mere 
mature. . . " 

Christensen analyzed twenty recent or contempo- 
rary writers - ten of narrative and ten of expository 
writing - to determine by what constructions they 
open sentences. The findings are In direct opposi- 
tion to the traditional teaching: the professionals 
place something before the subject In only a foirth 
of their sentences (24, 4? percent); that Is, over 75 
percent of their sentences begin with the a ubje c I. 
Of those opening by something ether than the sub- 
ject 23 percent of the total sentences open with ad- 
verbial modifiers, 1, 17 percent use verbal groups, 
and the Inverted structure appeals in only one of 
every three hundred sentim.es (0. 32 percent of the 
total sentences). The excessive use of verbal group 
logs as openM s produces a style thkh Christensen 
calls "pretzel prose": that Is, twisted s e nt > nc es. 
He concludes: "The good teacher shou I d not only 
base Ma teaching on the pr at t Ic e of professional 
writers, but should himself practice before h e 
pcevbee. ** 

In another study ChrUtensen (1953s) develops 
what he calls "A Generative Rhetoric of the Sen- 
tence." He prevnts a scheme for the purpose 
of "buckling down to the hard work of miking a dif- 
ference In the student*# understanding and manipu- 
lation of language. ” From Ms own analysis and 
that of others he drsws four principles underlying 
the rhetoric of Ihe sentence: 

I. Composition Is essentlilty a process of Addi- 
tion. 

1 The cumulative centence requires direction 
of modtfkittan or dLreclion of movement. 

3. Additions are made In levels of generality or 
levels of abstraction. 

4. Density of feature tsacUevedby rddlng frequent- 
ly and much to nouns, verbs, and main clauses. 
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TABLE l 

MARK OF MATURITY IN WRITING 





Average length 
of clauses 


Ratio of 
clauses per 
T-unlt 


Average length 
of T- units 


Ratio of 
T-unlts per 
sentence 


Average 
length of 
sentences 


Grade 4 


6. 6 words 


1.20 


8. 0 words 


1.6 


13. & words 




77 percent 


77 percent 


60 percent 


137 percent 


80 percent 


Grade 8 


8. 1 words 


1.42 


11. 5 words 


1.37 


15. 9 words 




94 percent 


85 percent 


80 percent 


117 percent 


94 percent 


Grade 12 


8. 0 words 


1.88 


14.4 


1. 17 


16. 9 words 




100 percent 


100 percent 


100 percent 


100 percent 


100 percent 



Using visual tiulytl* Christensen shows how sen* 
te nces are built (or generated) by the process of co- 
ordjnaMon (addition of parallel elements), by subor- 
dination . (sddltkm of levels of modification) orEyi 
combination of coordination and subordination. In es- 
sence Christensen recommends and demonstrates 
the superiority of the cumulative sentence over the 
complex sentence. His technique of analysis can er 
rich the study of literature as we 11 as develop ma- 
ture writing. 

Two years later Christensen extended his theory 
of the sentence to the study of the paragraph. Using 
a parallel title “A Generative Rhetoric of the Para- 
graph” (Christensen, 196$), he shows that the prin- 
ciples of analysis he developed for sentences apply 
with equal cogency to the paragraph; that is, para- 
graphs are created by addition, involving coordina- 
tion of elements, subordination of elements, or com- 
binations of the two. As well as addition, there 
must be also direction of movement; there w Hi be 
levels of abstraction, and varying density of texture. 
In applying these principles he formulated them un- 
der nine beadlrgs, a few of which are: 

3. The paragraph may be defined as a sequence 
of structurally related sentences. 

t. The top sentence of the sequence la the topic 
sentence. 

4. Simple sequences are of two sorts: coordi- 
nate and subordinate. 

4. dome paragraphs have no top, no topic, sen- 
tence. 

The nine headings are developed by expositor* and 
Utustratiofl. The conclusion to be drawn is that the 
paragraph may be studied and taught as the sente >ce 
la studied and taught by Christensen. 

A. L Berber (190$) offers a different ana lysis of 
the paragraph under the title n A Tag men 1c Ap- 
proach to Paragraph Analyst a ” A Tag me me la de- 
fined as the shortest grammatical unit; Becker calls 
them spots or slots in a system where substitution 
U possible. They are composites of lota and fine* 
Don. Limiting hi a analysis lo expository paragraphs, 
Becker finds two fundamental patterns. Theriral 
haa three functional slot* which be labels T (topk). 



R (restrictions), and I (illustration). These clots 
correspond to three levels of generality in para- 
graphs (cf. Christensen) and reflect a natural way of 
talking or wrltlrg about something. 

The second major pattern haa two ilcti labeled P 
(problem) and 3 (solution). The P maybe a quest ion 
or an assertion; the 8 is the answer or re spun \t. 
Where the S la extended, It tends to follow to TRI 
structure. The majority of expository paragraphs 
fall Into these two basic patterns. 

Variations in the patterns are caused by deletion, 
reordering, additko, and combination. The formal 
markers of internal tagmemlc structure are graphic 
(indentation), lexica) (equivalence classes and lexi- 
cal transitions), grsmmatlcal (changes In the gram* 
malic it role of equivalence classes signal new slots 
or new paragraphs), and phonological (shift sin pitch, 
register, tempo, and volume In oral reading). 

This analysis makes possible the partitioning of 
paragrtphs In a consistent and predictable way. 

The accurate and impartial evaluation of compo- 
sition la one of the major problems of English leach- 
ing. Paul Dlederkh (ifttftj made a study of the fac- 
tors (hat account for differences In the grade a of 
qualified readers. Three hundred papers on two 
subjects were read by sixty distinguished readers 
representing alt different fields: English, social 
studies, natural science, writers and editors, law- 
yers, and business executives. By comparison cf 
the r»Urge of three readers who stood highest in a 
parties la? lector wl*h three who stood lowest in the 
samefKtor, It wit possible to isolate influential 
factors tn all, 11,018 comments on 3,557 papers 
were tabulated. 

The factors revealed stood in this order of fre- 
quency: Ideas, mechanics, organisation, wordir^, 
style cr 4, flsvor. M For experiment si ion in high 
schools, these were divided into two group*: L Gen- 
eral Merit (ideas, organisation, wording, and f la- 
rorljTL Mec hank a (usage, sentence structure, punc- 
tuation, capitals, abbreviations, spelling, hand- 
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TABLE 2 

DISTRIBUTION OF RATINGS 





Non- Academic (N ■ 476) 




Grade 


10 (145) 


11 (167) 


12 


High 


5 percent 


8 percent 


9 percent 


Middle 


34 percent 


53 percent 


63 percent 


Low 


61 percent 


39 percent 


28 percent 



wrltLng, neatness). A rating card was developed 
for tbe use of evaluators. A close following of the 
techniques developed by Dlede rich, with a year of 
practice for a faculty, should yield a reliability of 
the cumulative total for each student close to . 90. 

In the same article Dledertch (1966) develops an 
elaborate but iractlcal procedure for the rating of 
large numbers of papers. By a process of sorting 
and grouping of anonymous papers of combined grade 
groups, such as grades 10, 11, and 12, the process 
rebuKs In precentage figures for selected groups 
like Non- Academic and Academic with significant 
differences for High, Middle, and Low In each group, 
ar.d a recognisable growth figure from grade 10 to 
grade 12. This extract (see Table 2) from a senior- 
high population will illustrate the dlst r Ibu t ionof 
ratings. 

In \h«s lower ability group the progress In the 
highest level Is slight but observable; 4 percent. 
The progress in the middle level is striking: from 
34 percent to 63 percent; the reduction in the low 
group is equally striking: from 61 percent to 2h per- 
cent The figures from the Academic g r oup show 
great advances In the high and middle level. This 
prxedure demonstrates to teachers, administrators, 
and parents a positive progression of improvement 
not demonstrable by customary paper - grading 
processes. 

fttStAMH M 
lAtfWAtt UAtMK 

Ruth Strkkland (1962) undertook to analyte th e 
structure of children’s oral language in the first 
through the sixth grades, to compare it with the 
structure of language found In the tuts designed to 
teach children to read, and to disco vet , at selectee 
grade levels, the Influence of any ostensible differ- 
ences In the quality of children's resding skill. A 
major hypothesis was that a study of child r e n's 
speech might offer suggestions tor the construction 
of better textbooks In resding. 

In the analysis of structure, twenty-five consec- 
utive sentences recorded on tapes were used as the 
language sample for each child. A special Rheme 
was devised for the analysis of the language at two 
levels. Level One was divided into " slots" or sta- 
tionary elements, and "moveables, *' or elements 
which can appear In different positions. Level Two 



was concerned with the types of subordinations or 
"satellites" used In the fixed slots and the move- 
ables. This structure analysis is an Important con- 
tribution of the of the study. Tabulations from this 
analysis were programmed to computers to relate 
the frequencies to the variables of age, sex, Intelli- 
gence, socio-economic status, and parent education. 
It was found that many similar patterns were used 
with great frequency by children of every grade. It 
was also noted that children of all levels used a wide 
range of language patterns, and could elaborate and 
expand sentences by the use of moveables and sub- 
ordinate elements. 

In the comparison of children's language with that 
of textbooks In reading, four sets of widely used 
textbooks were analysed for language patterns. The 
patterns used by children and by texts at relevant 
grade levels were studied. No scheme for control 
ovtr sentence structure to parallel that over vocab- 
ulary seemed to exist. This raises the question; 
Can knowledge of *ha structures used by children be 
used to devise textbooks controlling the difficulty of 
reading? 

A study of the relationship between children's 
use of language and the skill they demonstrate l n 
learning to read in grade 6 revealed that children 
ranking high in the variable elements m r\de more 
use of the common oral structural patterns than did 
children ranking low; the same children also made 
greater use of moveables and elements of subordi- 
nation than did children ranking low. Among the 
conclusions to be drawn are tht*e: 

a. Children's command of language patterns I s 
much broader than Is generally realised. 

b. There is almost no relationship between chil- 
dren's oral patterns and the patterns of struc* 
tare In reading texts. 

c. Children can be helped to recognize the pat- 
terns of expression and by th is means be 
aided to advance in reading and In the learning 
of grammar a*d usa t. 

Walter Lcban, of the University of California,! e- 
gtn In 1952 a longitudinal study of children's growth 
In language which continued for eleven years. His 
report The Language of Elementary School Children 
(L^an, lSWccvez s the first seven years, theele- 
menUry school level. Trom the Oakland, Califor- 
nia schools 336 subjects were chosen at kinderga r* 
ten level and were observed and tested Inthe follow- 
ing years. Rem* especially studied were: their vo- 
cabulary, their use of oral and written language, 
their proficiency in reading and listening, teachers' 
Judgments of their skill wtth language, and back- 
ground Information on their health and homes. 

Lob in developed what he calls "tbe communica- 
tion unit" In anaty ling children's speech. It maybe 
dellned as a group of words which cannot be further 
divided without the loss of their essential meaning. 
Another term he developed is "the maze, M a series 
of words or Initial parts of words which do not add 
up to meaningful communication. Language sam- 
pics recorded on disks and tape s provided the 
aource materials. Two sub-groups, one exception- 
ally high and one exceptionally low in la^uage abil- 
ity, were Identified. 
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A largo number of specific findings have been 
summirlzed In the published report £8 follows: 

During the first seven years of schooling, c h 1 1- 
dren speak more word* In each succeed Ing year, 
produce more communication units, and Increase 
the average number of words In those units, 

Children rated as skillful In language reduce both 
the'r Incidence of mazes and the number of words 
per maze. 

Not pattern, but what la done to achieve flexible 
ity within the pattern proves to be a measure of ef- 
fectiveness and control of language at this level of 
language development 

Children who are rated as most proficient In lang- 
uage are also those who manliest the most sensitiv- 
ity to the conventions of language. 

Those high (n general language ability are also 
high In reading ability. * .Writing ability Is related 
to socioeconomic position • • * The highest correla- 
tion In the study is between vocabulary And intelli- 
gence* * ■ A low but positive relation exists between 
heshh and language proficiency * * * Competence In 
the spoken language appears to be basic for compe- 
tence In reading and writing. 

An important aspect of language learning In chil- 
dren Is their ability to learn and use standard Eng- 
lish. Loban In Problems In Oral English (1966) 
stiles that for most children t commando! standard 
English is necessary, for “society exacts penalties 
of individuals who do not possess It. ** In continuing 
his longitudinal study of children's language, Loban 
here examines examples of nonstandard oral usage 
among four different groups of school children from 
kindergarten through grade 9. His chief 'ndingt 
hare been sum mar I ted thus: 

In ten years of schooling, pupils from homes In 
which class dialect Is used make almost no improve- 
ment in :slng the verblo^beapproprlately or In 
standardized verb forms. 

The practice, so common among weaker teach- 
ers, of drilling all pupils on the same skill is not 
supported by this research. Individual pupils, but 
not whole classes of puptlt, will need help If they 
are to use the standard forms of irregular verbs. 

As the complexity of sentence structure and total 
volume of spoken Urguage both Increase, there is a 
more t han proportional probability of difficulty with 
. . . pro5Iema ot cla/lty and precision, not problems 
of habitual osage. 

Almost all the puptls whose parents speak Irtfor- 
mal standard English have little need of drill ov 
usage. 

Oral drill Is more effective than workbook drills, 

TUI IMOMK OAMMAIS 
AM MAIKT SWT 

In the last fifteen years a fundamental tenet of 
English teaching, namely, that there is one gram- 
mar of English to he learned and taught, has been 



blasted by the development of at least two other sys- 
tems of English grammar and the reasonable expec- 
tancy of others to follow. If Is no longer accurate 
to speak of the grammar of English except in refer- 
ence to the complete operation of the English lang- 
uage. We now have several grammars, each a sys- 
tem to describe how the English language works, or 
more specifically, how English makes sentences, 
The traditional system was developed principally in 
the eighteenth century by scholars whose grammat- 
ical disciplines were derived from Latin and Greek. 
Traditional grammar, therefore, was developed to 
make English conform .to structural principles of 
Latin and Greek, Aside from certain cusslcal bi- 
ases, and lack of then undeveloped linguistic pr I n- 
ciples, it is a system of analysis of English of great 
value in the past and (s by no means obsolete at pres- 
ent, unless viewed asthe grammar of English. 

In 1652 C. C. Frlea Introduced structural gram- 
mar. He was chief among a number of scholars 
working along parallel lines. The contribution of 
structural grammar Is accurate description: It ts 
concerned with the detailed elements of a language, 
Its sounds, word units, Inflections, and syntax. In 
the latter, analysts Is conducted on the basts of Im- 
mediate constituents as operating ip modification, 
predication, complementation, and Subordination. 
Structural grammar has greatly enriched knowledge 
about the elements of English andthe manner in 
which they are combined to express meanly, 

Noam Chomsky (1951) of MIT brought out In pub- 
lished form a new approach to grammar under the 
title Syntactic Structures . Somewhat modified by re- 
vlelons. this newest of grammatical l heo r l e s has 
great promise for the future. Generally called gen- 
eratlve-transformatlona 1 grammar, it is a system 
which attempts to state the “rules" which generate 
all English sentences and only English sentences. It 
assumes that we have in us a mechanism for using 
these laws wVch we gain from intuit Ion. We are 
therefore able to generate sentences that have never 
been uttered before. The analysis begins with ker- 
nel sentences, simple declarative sentences without 
development. From these kernels other sentences 
sre derived by means of rules tor transformations, 
rules which charge or develop kernel tettences con- 
taining phrase structures which are grammatical 
parts of a grammatical sentence. The goal of this 
new grammar Is to state the rules that will make the 
production of sentences predictable 

Applications of structural and transformational 
grammar far classroom purposes are de reloped fay 
Owen Thomas (1965) aid Paul Roberts (1964). The 
for mer develops the transformational system in easy 
stages for the English teacher to understand and utl- 
llte the processes of gene rat Ire -transformational 
grammar in the Instruction of students. The latter 
presents a set of programmed lessons for se 1 (-in- 
struct km ir. the new grammar. N. S. Blount (Blount 
and Johnson, 1966) cf Madison, W isconsin, has cre- 
ated a similar programmed series of lessons adapt- 
ed to the eighth grade. 

The following curriculum question arises: <r Wh*t 
happens to students who are Uueht the structure ot 
English fay generative transformational processes?'* 
Bateman and Kidoru (1966) offer a tentative answer 
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as the result of an experiment withninth-and tenth- 
grade students. Using equivalent experimental and 
control groups, they taught the former by transfor- 
mational techniques and the latter by traditional 
techniques. A valid sampling of free w r It i ng of 
each student was collected at the beginning and end 
of the instruction. The analysis of these writings 
by the Hunt (19G5b) process revealed thatthe exper- 
imental group wrote better sentences of more so- 
phisticated structure than did the control group. A 
parallel experiment is now under way at Manitowoc, 
Wisconsin, under the leadership of N. S. Blount of 
The University of Wisconsin, Madison. 

A D ictionary of American Regional English is hi 
progress, centered at The University of Wisconsin 
and directed by F. O. CassLoy of the Department of 
English (1066). Such a dictionary has been planned 
for over seventy-five years, and active collecting 
has been going on since I860. Now under a 5-year 
contract with the U. S. Office of Education the work 
is progressing rapidly. Collections of data for six 
states, including Wisconsin are c o m pi e te d; six 
jnore are partially completed. Work of a similar 
nature is welt under way in eteven more states. 
Many o( the field workers live and work in "Word 
Wagons, " specially equipped small buses contain- 
ing the essentials of living quarters and apparatus 
for field collection. 

Data are assembled, classified, and placed In a 
computer file at Madison. Collectors record speech; 
readers analyte regional literature and local news- 
papers. The effort is to secure complete coverage 
of the words and expressions used differently in var- 
ious areas of the United States. 

Curriculum applications of this study have yet to 
be worked out, but they will Include 1) greater and 
more precise knowledge of American dialects; 2) a 
classification of usage levels and standards; and 3) 
new attitudes toward local and regional language 
variations. 

WISCONSIN OHrUSH 
CUtftKWUM ACTIVITY 

By means of a Federal conttact initialed In May, 
1063, the State of Wisconsin has been served by the 
WlsconsIn-Engltsh-LanguageArls Curriculum Pro- 
ject, Jointly sponsored by The University of Wiscon- 
sin and the Department of Public Instruction. By 
m«ans of two series of bulletins, Conferences, con- 
ventions, and personal school visits. more than 
5,000 elementary- school and high-echool English 
teachers have been Involved, many very actively. 
The project Is, in fact, a statewide tn-servketraln- 
Ing program In the English language arts. The aim 
Is to encourage teachers to think, confer, discuss, 
and write about the curriculum In English. They 
have responded magnlftcantty. Over 3,000 bulletins 
go out each month; In the larger cltks these are 
duplicated and distributed to additional number* of 
teachers. By means of the reports of group leaders 
the project director is Informed of the number of 
teachers who sire meeting, the grade te vets they 
represent, and their views on the issues that are 
raised. 

tn the summer of 1064 a selected group of teach- 
ers representing all school levels met to produce a 



curriculum In the teaching of literature - a cumula- 
tive growth pattern from the kindergarten through 
grade 12. After some months of revisions andedlt- 
ing, this was published in January of 1 965 as Teaching 
Literature In Wisconsin , a paper-bound volume of 
160 pages. Nearly 5, 000 copies were distributed 
free in Wisconsin; it is estimated that ths total dis- 
tribution, Including sales at cost, is about 17,000 
copies. 

By a similar process in the summer of 1965 a 
new group of selected teachers prepared the mat c- 
rials for the volume Teaching Speaking and Writing 
in Wisconsin (1066). Over 4,0o0 copies were dis- 
tr<buted free; a large number have been sold at cost. 

Again In the summer of 1066 Iwo curriculum con- 
ferences were held, the first composedof ten selec- 
ted college or university teachers who used their 
linguistic knowledge and experience in the teaching 
of English to plan the language curriculum. This 
was followed by a group of teachers representing el- 
ementary, Junior high school, and senior high school 
levels which was to work outa contlnuumof language 
learning from kindergarten through grade 12. The 
result of this creative work and subsequent editing 
was Issued in February of 1967under thetltle Teach - 
tng the English Language In Wisconsin. Featured 
In this volume are: 

1. A linguistic approach to grammar, utilizing 
simple applications of structuraland transfor- 
mational grammar to the language learning of 
children and youth. 

2. A program that Is sequential and non -repeti- 
tive. 

3. A grammar that provides for more sophisti- 
cated sentence analysis at the time students 
need it. 

i. An enrichment of the language program by the 
Inclusion of word-study, semantics, and the 
history of the English language. 

The three curriculum volumes listed above are 
Issued In experimental editions. They were thor- 
oughly revised in the light of experience In theciass- 
rocm and reissued in the Spring of 1966 as one vol- 
ume entitled F ng llsh - Langu age - Ar Is in Wis - 
consin 
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THE COMMITTEE lor Research In 
Basic Skills has open! a number of y c a r s investi- 
gating problems of teaching and learning fundamen- 
tal skills In the elementary grades. Generally, the 
Committee has chosen to be exte n al ve in Its ap- 
proach, Investigating many dimensions of a g I v e n 
: oblem. As a retail, there hare been a series of 
^todies within bread problem areas. 

The present nveatlgaUon grew out of a recurring 
concern for pupils* development of flexibility in per- 
formance in the basic skill areas. In a project en- 
titled "The Perception of Symbols In Skill Learn- 
ing,” Herrkk, Harris, tndRarlck (IMl)estab- 
llsbed the importance of the development of variabil- 
ity rather than t gldity In motor-speed seta of hand- 
writing. The authors, pointed cut that their findings 
might well have Imptlealtont for other areas of 
skills development. The question of flexibility arose 
again In two studies (Runs and Rukk, lft$7; Her- 
rick and Otto, SMI) of the handwriting act One Im- 
plication of these studies was that efficiency Ins 
skill such as handwriting doe* not seem to be asso- 
ciated with the development of a fixed level of pres- 
sure but rather with the ability to control pressure 
within given limits. Another study by Otto (I Ml) In- 
dicated that among good readers In the elementary 
grades reeponalvenera to auditor y, visual, kines- 
thetic, and combined presen tat Ions of st I melt rules 
according to grade level and type erf reinforcement 
The vulance, however, was not a hray a In the direc- 
tion expected, which suggests that one effect of the 
Instructional program may be the develop- 
ment erf perceptual seta In reading. 



These studies led the Committee to the U. $, Of- 
fice of Education Project Ho. 1755, "The Ex perl- 
mental Development of VuUbillty In Rate of Read- 
ing In the Intermediate Grades" (Hurls, He r r It k, 
Macdonald, and Ruick, IMS). The results of the 
study showed that fourth-grade good readers who re- 
ceived • 2-week training program developed substan- 
tial ability to vary their speed when reading for dif- 
ferent purposes. In the training program the chil- 
dren were given a) a brief introduction to three types 
of reading purposes - reading for the main idea, 
reading to find a specific fact, and reacting to follow 
the sequence of Ideas, b) short testing and training 
passages ctrekliy constructed as to unity , coher- 
ent), emphasis, and appropriate content and d Iff i- 
cu\y level, c) separate selections for nurattve and 
expository style, and d) testing to a criterion of full 
Comprehension of each specified purpose. Specifi- 
cally, the children were shown to a) possess a hither- 
to unreported ability to adjust slgnrflcanliy their 
reading speeds very qukfcly to the tr purposes for 
reading; b) alter significantly their pattern of read- 
ing speed relative to reading purposes and to main- 
tain a significant spread tn speed-purpose vu labil- 
ity while Increasing their reading speeds for each 
ixirpose approximately 40 percent, with further 
gains upon retention testa two weeks after tralnlrg; 
c) adjust their reading speeds to reading purposes 
significantly different according to pa a sage style 
and to a certain extent according to sex; d) and dis- 
play tbe greatest improve meat In r e ad leg tor the 
main idea and specific fact. The results of Project 
HSS also showed that a) children (rfcomparable 
reading ability to the fifth end atitth grade* hive 
no more vutabllity or spread In their read irg speeds 
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according to reading purposes thandofourth graders; 
b) children, by their own dally ratings, greatly en- 
joyed the 2-week training period which was largely 
self- Instructional In nature ;c) during the short 
training period, children became significantly more 
realistic In predicting their reading speeds when 
asked to read for sequence of ideas, but not for 
main idea or specific fact; and d) no untoward e vl- 
dences of tension were found to be associated with 
reading the test passages or answering questtonson 
them. 

In keeping with Its past policies, the Committee 
wanted to relate directly its research tasks to spe- 
cific aspects of school practice or to pro v id e the 
basis upon which its findings could be generalired 
to school programs. The experimenters felt that 
before schools could be expected to Implement the 
findings of Project 1155 In their programs, they 
should have empirical evidence that the results of 
training given under the aforesaid experimental con- 
ditions would indeed transfer to more typical read- 
ing tasks faced by intermcdiale-grade child ren. 
The present study Is, therefore, an exie ns lo n of 
Project 1755 specifically designed to Investigate the 
possibilities of such transfer effects. 

The first part of the present study replicated the 
training and testing of Project 1155. The only major 
revision In the first part of the study was in the sub- 
stitution of a second active learning group for a pas- 
sive control group. Since the preceding study gave 
evidence that trained groups achieved greater vari- 
ability than 'ttntrols, It was felt to be more perti- 
nent to test for significant differences between types 
oftralnlng. Therefore, half of the subjects we re 
trained with passages containing an explicitly stated 
main idea and the other half worked with passages 
In which a main idea was Implicit but not stated. 
Classroom materials may or may not c o n t a I n ex- 
plicit main Mea statements so the Intent was to de- 
termine whether training with either type would pro- 
duce belter results. 

Three major hypotheses were stated: 

1. Intermediate -grade children trained with pas- 
sages containing either explicitly stated or 
implicit main Ideas will differ In rate vari- 
ability when reading carefully structured ex* 
poslu y or Mrratlve materials for three dif- 
ferent purposes. 

I, Infer mediate -grade children trained with pas- 
sages containing either explicitly stated or 
implicit main Ideas will transfer their varia- 
bility of reading rate to m>re typical materi- 
als. 

3. Intermediate-grade children trained with pas- 
sages containing cither explicitly stated or 
Implicit main kievs will retain their variabil- 
ity erf reading rate with typical materials after 
a period of one month. 

Answers to the (oUowlrg questions were sought: 

I. Do children differ In their totil reading rale 
when reading either narrative or expository 
material for three different purposes? 

1 Do boys and girls In grades 4, 5, and 6 trained 
with passages containing specifically stated 
main Ideas and children trained with passages 
In which main Ideas were Implicit, bat not 



6tated, differ In their rale variability when 
reading either expository or narrative materi- 
als for three different purposes on a tralnlng- 
like task Immediately after training? 

3. Do boys and girls In grades 4, 5, and 6 trained 
w>th passages containing either explicitly 
slated or implicit main Ideas differ in the lr 
rate variability when readlngeilher expository 
or narrative materials for three different pur- 
poses on a transfer task Immediately after 
training? 

4. Do boys and girls In grades 4, 5, and 6 trained 
with passages containing either expl ic Illy 
stated or implicit main ideas differ in their 
rate variability when reading either expository 
or narrative materials for three different pur- 
poses on a a) training- like task Immediately 
after training; b) transfer task immediately 
after training; c) transfer task one month liter 
training? 

5. Do children vary their rate w he n reading 
either expository or narrative materials for 
three different purposes - specific f act, se- 
quence, cr main idea on a a) t r a 1 n I n g - like 
task immediately after training; b) transfer 
task Immediately after training; t) transfer 
task one month after training? 

MFTHOO 

SUBJECTS 

In the final analyses, seventy-two children from 
grades 4, 5, and 6 of a middle-class elementary 
school in Madison, Wisconsin, served as subjects. 
There were twenty-four subjectsateachgrade level, 
twelve boys and twelve girls. In an attempt to ex- 
clude the extremes of reading ab.lity, subjects were 
chosen who K*i reading test scores that placed them 
between the fortieth and ninetieth pe re entiles for 
their grades. The STEP Reading Test was used in 
grade 4, the Reading ''omprehenslon subtest of the 
California Achievement Test was used In g r ad e 5, 
and the Iowa Reading Test was u sed In grade & 
School personnel corroborated the r eadlng test 
scores. Table 1 shows the perc entile range by 
grade and sex. 

Within sex and grade level, equal numbers of sub- 
ject! were randomly assigned to Ihe two treatment 
groups. To guard against attrition due to absence, 
Inability to cope with the task, and examiner ei rors, 
extra subjects, one boy and one glrifromeachgrade 
level, were included tn each treatment group. There- 
fore, the treatment groups comprised forty-lwo 
children, of whom six were not Included In the anal- 
ysts. The evtra subjects remaining after attrition 
were randomly dropped. 

EXPERIMENTAL TREATMENTS 1 

The distinction between groups was In 1) ihe na- 
ture of orientation to reading for Ihe main Idea and 
2) the structure of naterlats read during the orien- 
tation and training prlods. During these periods, 
Croup t worked with materials 1 In which a main 
Idea was explicitly stated; the task in reading for 
the main Idea was to Identify the main Idea from a 
lle» of sentences lateen from the passages read. 
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TABLE 1 

PERCENTILE RANGE OF SUBJECTS’ READING TEST SCORES BY GRADE AND SEX 



Sex 






Grade 






Fourth 


FUlh 


Sixth 


Highest 

Percentile 


Lowest 

PercenlUe 


Highest 

Percentile 


Lowest 

Percentile 


Highest 

Percentile 


Lowest 

Percentile 


Boys 


86 


48 


90 


62 


87 


40 


Girls 


90 


50 


90 


54 


89 


57 


Total 


90 


48 


90 


54 


89 


40 



Group 11 worked with the materials from which the 
stated main Idea had been deleted; the (ask in read- 
ing for the main Idea involved formulating i m a 1 n 
Idea and then selecting the main Idea sentence from 
a list Identical to the one used by Q r oup L Both 
groups worked with passage# of Identical length and 
essentially the same substantive subject matter. 

MATERIALS 

Materials for orientation to the task, for varia- 
bility training, and for Immediate post training eval- 
uation were taken, with bu* minor adaptations ex- 
plained below, from materials constructed for Pro- 
ject 1755. Longer materials, more representative 
of the type encountered by elementary pupils, were 
constructed for use In the attempts to a s s e s s the 
transfer effects of the variability training. The de- 
velopment of materials was a major focus In both 
the present project and the one that preceded It; 
thua, the materials are described In considerable 
detail. 

ORIENTATION MATERIALS 

The orientation materials comprised three sets 
of passages, one set for each o( the three purposes 
for reading (see descrlftlon of the training program). 
Each passage was printed separately on charts 
which could be read from the location of any pupil 
tn 'he testing room. A list of fire names with cor- 
respond!^ telephone nutribers was used in finding a 
specific fact. Reading for sequence in voir ed one 
bask paragraph with three different orderings of its 
fire sentences. For Croup I orientation to reading 
for the mam idea also employed a bask paragraph 
which was rewritten three times so that the topic 
sentence appeared tn different parts of the passage. 
The materials were taken from those dere loped for 
Project 115$. 

Because all of the Project 175$ materials In- 
cluded explicitly staled main Ideas, the following 
adaptations were required for use with Or oap |L 
First, the sentence stating themalnidea was de- 
leted from the passage used to orient the subjects 
to reading for the mate Idea passage and the remain- 



ing sentence* were expanded slightly to preserve a 
uniform length. Second, an additional paragraph 
was used with Group U during Its orientation to the 
purpose of reading for the main idea. This ptra- 
graph was similar to the first one In topic and con- 
struction, but It was used to provide further clarifi- 
cation of the task and practice in arriving Independ- 
ently at a conception ot the main Idea. A pilot study 
showed that the added practice was needed. 

TRAIN INQ MATERIALS 

The training materials developed In Project 1755 
and used in the present study consisted of three 
parts; a set of directions, the passages to be retd, 
and comprehension check3. Brief d e sc r I pt lo n e 
of each of the three parts of the tralnlr^ materials 
follow. 

Directions 

The primary purpose of the directions «a • to 
establish a definite purpose for reading either to 
find the Main Met, The Sequence of Events, or» 
Specific Fsct. Thus, ft speclfk question was asked 
for esch selection to be read for a Specific Fact, 
and when the put pose was to read for Sequence or 
Main Idea , the subject was told to read to 1 1 nd the 
Main Idea or to remember the order of events. Tt»e 
directions were designed to make the training sett- 
ing! roc l tonal. 

Passages 

The passages were written with the following re- 
strictions and considerations in mind. The content 
of the trainirg materials was front the areas of so- 
cial studies, science, or fklton because Shores' 
(i960) research Indicates that reading speed la af- 
fected bf different kinds of content 

The passages were written In narrative and ex- 
pository styles because a pilot study In Project 1755 
showed that expository materials were read faster 
than narrative, yet pupfla commonly encowter both 
styles. 

Passages were given either an Inductive structure 
0- e. , the topk sentence came n e a r the end of the 
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selection) or a deductive structure (i.e., the topic 
sentence came near the beginning of the selection). 
The decision to consider structure of the material 
was based upon results of pilot testing In Project 
1755 which Indicated that children perform be t ter 
on paragraphs organized deductively than inductively. 

Passages were llmlled to sLx to eight sentences 
with total word count ranging from 66 to 112 words 
since the earlier pilot study showed that fourth- 
grade students had much difficulty with longer se- 
lections before training. 

In an attempt to keep the passages wit hi n the 
fourth-grade readability level according to the Dale- 
Chill formula, the vocabulary was limited to grade 
A word lists, sentence length was limited los seven 
to fourteen words range, and typical subject-verb 
word order was maintained within the sentences. 
Each passage was allowed a maximum of two exam- 
ples of the syntactical complication which follows: 
relative and subordinate clauses, participial 
phrases, Infinitive phrases separated from the main 
verb, arid Inverted subject-verb word order. Five 
teachers with experience In the intermediate grades 
Judged the difficulty of the materials to be appropri- 
ate. As an added check, the directions for each 
passage encouraged the subjects to ask for vocabu- 
lary help as needed. 

Each passage has a single main Ides. Group! 
practiced with passages In which a main Idea was ex- 
plicitly stated; Group D practiced with passages in 
which the same main idea was implied but not staled. 
In the passages where the main idea was not stated, 
adjectives, adverbs, and other words which did not 
change the meaning oif the paragraphs we re inserted in 
the remaining sentence s to yield a constant paragraph 
length. The natvre of the dally training materials 
Is shown In Table 2. 

Comprehension Tests 

The position was taken that the reader should 
have access to all the passage units when selecting 
the appropriate main Idea or determining the proper 
order of Ideas. Thus, for the main Idea and se- 
quence ta ska the comprehension tests contained a 
condensed or abridged restatement of eschof the six 
to eight sentences In the passage itself and the sub- 
ject either Identified the main Idea statement or se- 
quentially ordered the statements g Ivc n. For the 
specific fact tasks, a phrase containing a spec If Ic 
fact was talun from each sentence and the svfbject 
identified the correct one. 

POST- TRAINING MATERIALS 

The directions and comprehension tests used with 
the post-training materials were of the same type aa 
the training materials proper and the passages we re 
likewise adapted from paragraphs constructed (or 
Project 1755. SU of the passage a were written with- 
out s stated main Idea and abt were written with an 
etpUctt main Idea. Each passage waa a Inly - a it 
words long, Including fire sentences If the main Idea 
was not stated or abt sentences If K was stated. 

TRAMFER MATERIALS 

The central question of the study Is whether var- 
iability In reading speed developed by irxinKr* with 



TABLE 2 



NATURE OF THE DAILY TRAINING PROGRAM 
MATERIALS 


Number 


Selection 


4 


Main Idea Selections 


1 


S quence Selection 


1 


Specific Fact Selection 



carefully constructed, short model paragraphs will 
transfer to reading the longer, less tightly struc- 
tured passages typically found In classroom materi- 
al. Thus, the decision was to use the types of ma- 
terial actually employed In classroom Instruction In 
the transfer task. With this decision, there was the 
problem of learning more about the nature and length 
of r, typlcal M paragraphs In elementary level materi- 
als. A preliminary survey of tradebooks and text- 
books, especially l. 1 reading series, revealed a 
lack of consistency wi i'ji intermediate level materi- 
als and even within Individual publications. 

It hid at first been assumed that construction of 
the transfer materials would involve the useof a cer- 
tain number of paragraphs, but the survey revealed 
that there was a surpiising lack of correspondence 
between paragraphing and topical units. Within a 
single paragraph, two or three topics might be dis- 
cussed; yet at another place in the same material 
several paragraphs might be used to cover one topic. 
Since one of the purposes for reading In the study 
Involved the Identification or formulation of a main 
Idea, the experimenters decided to select passages 
that contained only one main Idea, regardless of the 
total number of paragraphs Involved. The survey 
showed also that there was little consistency amor.g 
the materials with regard to the rr mber of wo r d s 
used In the coverage of a single main Idea. Because 
the experimental design of the study called for avinl- 
form length In the transfer test materials, the ex- 
perimenters arbitrarily set the lergth at IM words, 
three timea the number of words In the post-trslnlrg 
test materials. 

With consideration for ill the factors Involved In 
the looseness or tightness of the structure of msto- 
rlals at the intermediate grade levels, the expert* 
mentera decided that selections from the intermedi- 
ate level Rea der s Digest Skill BuUders were rea- 
sonably representative of materials used by children 
In the fourth, fifth*, and sixth grades. 

Passages were chosen from the Skill Builder a In 
▼lew of the following: each passage had to have a 
single, complete main Idea; each passage had to be 
appropriately written tor one of the three purposes, 
(l.e., tf the purpose were to read for sequence, the 
passage must obviously contain a c’ early recognis- 
able sequential derelopme.it); and ail of the passages 
chosen had lo be generally Interesting to lnte rft*Jl- 
ate- grade children but not specifically familiar to 
thiRL The Skill Builder selections were modified 
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only when necessary in terms of the addition or de- 
letion of a stated main idea, and/or the addition or 
deletion of unimportant words In order to keep the 
length constant. (The authors are indebted to the 
editors of Reader's D igest for permission to use 
their mater la IsTnd for their examination and ap- 
proval of all adaptations made In the materials.) 
Hal/ cf the selection s chosen were written In a pri- 
marily narrative style and half were expository In 
style. 

Equivalent sets oi materials were necessary for 
the immediate and delayed transfer testing. "Paira ,, 
of materials were developed by drawing two selec - 
tlons from the same Sk'll Builder article. Since 
these articles were very short, it was felt that vo- 
cabulary, style, and other factors affecting r e sd- 
sbility were likely to be reasonably equivalent. The 
selections In each pair were assigned randomly to 
Ihe Imnodtale or delayed transfer testing materials. 

Table 3 Is a breakdown of the total number of se- 
lections used for the transfer study. 

TRAINING AND TESrtNQ PROCEDURE 

In keeping with the framework established by Pro- 
ject 1753, the research program was divided into 
taro basic par is, training and testing, which were 
then subdivides with time designated for each part 
as shown in Table 4. 

Training Program 

Training Examiners . A week before the trslnlng 
program began, theVdult assistants met wlihthe 
graduate research ata/f for orientation to methods 
and procedures to be used. A brief history of the 
research rroject was given, and each assistant re- 
ceived a copy of the complete set of directions for 
each dr.y of (raining. Objectivity in working w lih 
the subjects was emphasized. 

Tracing Subjects. Days 1-3 of the trslnlng pro- 
gram served as an Orientation Period to prepare 
subjects to read for the three different purposes and 
to familiarise them with the materials and pr oc e- 
dures. The injects read three tractive passages 
each day. The orientation sequence Is show n in 
Table S. 

The difference between groups In the Orientation 
Period was In presentation of reading for the main 
idea. Group f practiced with stated m a In Ideas in 
their paragraphs while Croup D piactked with para- 
graphs with Implicit rain Ideas. This distinction 
was maintained throughout the training program. 

On daya 4* 10 the subjects practiced to r 30-45 
minute periods each day, during which they read 
six selections dally. The sections were randomly 
ordered for the total group of eighty -four subjects 
every day. 

In addition to reading passages, subjects also 
practiced predicting their reading s pe e d for each 
selection. This was followed by recording actus I 
speed on their individual graphs and on Time Record 
Sheets. It was feR that tMa would he Ip each subject 
evaluate hit ©*w progress; the graph would ev.vdt 



TABLE 3 

NATURE OF THE SELECTIONS USED IN THE 
IMMEDIATE AND DELAYED TRANSFER SESSIONS 



Selections for 
Immediate Transfer 




Selections for 
Delayed Transfer 


Stated Main Idea 


2* Main Idea 


2 


Main Idea 


2 Sequence 


2 


Sequence 


2 Specific Fact 


2 


Specific Fact 


Unstated Main Idea 


2 Main Idea 


2 


Main Idea 


2 Sequence 


2 


Sequence 


2 Specific Fact 


2 


Specific Fact 



♦There was one narrative and one expository 
selection tn each pair. 



him to vlsualiie the differences tn reading rale for 
e*rh of the three purposes for reading. 

On each of the seven priclice days, this pr oc e* 
dure was followed: 

1. Each subject received his set of 6e If -in sir vie* 
tlons) mater Isis and read the d l r e c 1 1 o r. s to 
establish s purpose for reading. 

2. Each subject predicted his reading speed on 
Ms graph. 

3. Fsch subject timed his reading of the selection 
with a stopwatch and recorded actual reading 
lime on Time Record Sheets. 

4. An answer sheet accompanying t he selection 
was then completed. 

3. Subjects were expected to read to full compre- 
hension or 100 percent accuracy In responding 
lo the comprehension test items. Due to the 
nature of the tests, five trials was the m a x i- 
mum. The assistants checked individual re* 
sponses after each trial. 

6. Raw time scores were translated Into words 
per minute scores by the subjects, who were 
supplied with conversion tables. 

7. Subjects then plotted reading speed on their 
graphs to show a comparison of predicted and 
actual reading speed. The graphing, was in- 
tended to serve as s mctlvalkxul device. 

AD MIN <ST RATION OF TRK TRAINING PROGRAM 

T* obtain manageable groups for the training ses- 
sions, Groups I and 11 were each divided into two 
tratnlr* groups cf twenty- one s«b Jetts, Three 
groups met separately tn the testing room during 
the morntr#, and one group met tn the afternoon. 

Tout research assistants conducted the Training 
Program. Since each had been involved in working 
on various phases cf the training materials and train* 
tng procedure, It was felt that they would be highly 
consistent In lhe!r administration of the four iraliv 
tng groups. Four or live adult assistants were 
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TABLE 4 



SEQUENCE 


OF TRAIN INO AND TESTINO 








Training Program 




Testing Program 




Orientation 

Period 


Training 

Period 


Post-Training 
Test Period 


Immediate Transfer 
Test Period 


Delayed Transfer 
Teel Period 


Days 1-3 


Days 4- 10 


Day 11 


Days 12-13 


Days 14- 15 
(one month 
follow Ing 
Days 12-13 


TABLE 5 

ORIENTATION SEQUENCE 


Day 1 




Day 2 




Day 3 



Introduction to introduction to Introduction to 

(I) three purposes for reading (1) Conversion tsbtes (l) predating feeding speed 

(I) use of stop watches (I) Orapha 

(J) use of Time Record Sheets 



available at each session to supervise the subjects' 
work. The resulting ratio of one adult for e ? e r v 
four or five subjects Insured adequate supervision 
of the work and Immediate feedback on the compre- 
hension testa. 

The following administrative details were pat- 
terned tfter Project 17$*: 

1. Training groups were no larger than twenty- 
one subjects. 

3. A large, well- ventilated, well- lighted, quiet 
room was used. 

3. Individual work space wts ivillabW for each 

paptl. 

4. All necessary supplies were provided by the 
researchers. 

$. One ft'fult was assigned to work with every 
four or fire subjects. 

6. Instructors and assistants were trslned in the 
testify procedures and to anticipate possible 
problems. 

7. Detailed printed Instructions we r e provided 
for Instructors and assistants. 

TESTING PROGRAM 

The procedure followed during the three phases 
of the Testing Program (see Table 4) deviated from 
the Training Program kn these ways: (IlFor the 
Post- Trebling Test, day II, 13 randomly ordered, 
sixty- tlx word selec'tows were read Instead cf the 



usual six selections of varying length. Four ran- 
domly ordered selections were retd for esch of the 
three fwrposes. The totsl reading time In seconds 
for each purpose was recorded. The pupils dll r.ot 
use their graphs. (?) The Immediate and Delayed 
Transfer selection* were Itt words In length. They 
are described In detail In the materials section of 
this paper. All subjects it >d twelve randomly or- 
dered selections, six with and six without t.t expli- 
citly stated main idea, for Immediate Transfer on 
days It and 13. One month liter, on days 14 and 
1*, they read twelve selections comprising the sec- 
ond half of the set of transfer materials. During 
the two transfer testing periods, the assistants re- 
corded the subjects* Mai teadlr* time In seconds 
when reading tor each purpose. No graphs or con- 
version tables were used. 



The ssrjmptlon wis that in order to assess t h e 
eifecta of the stated and Implied main Idea treatment 
conditions It wss necessary to lest the subjects on 
materials with and without explicitly stated main 
Ideas. A reasonable expectation would be that sub- 
ject i trained with stated main Ideas would do best 
on test materials which contained stated main ideas 
and those trained wHh materials having implicit 
main Ideas w<*)1d do best on test materials with Im* 
pile It mate Ideas. To assess the overall effect of 
the treatment conditions, the experimenters were 
concerned with the best performance oh both types 
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of materials. In order to get a score whch indicated 
this total performance, regardless of type of mate- 
rial, the mean score of the subjects* performance 
on narrative and expository material was found, 
thus reducing the number of scores for each subject 
to six. 

DESIGN AND ANALYSIS 

In order to determine the variability of reading 
rate for the three different purposes - specific fact, 
sequence, and main idea - a variability score was 
calculated for each subject. The style of the mate- 
rial was considered In that two rate variability 
scores were calculated for each subject - one for 
narrative and one for expjsitory materials. The 
variability scores were calculated according to the 
standard variance formula: 

S a = S fo 1 1 ^ . 

1=1 n - 1 

Xi was the sum of Individual scores where L varied 
across the three purposes; X was the mean of the 
three purpose scores, and n = 3. Thus, the vari- 
ance scores took into account the subjects’ reading 
rate for one purpose in relation to all pu r po s e s 
(mean rate). There were three different designs 
and consequently three different types of analysis. 

One was a subject X purpose one way analysis of 
variance design. The dependent v a r table for the 
analysis was the proportion of each individual’s 
reading rate for each single purpose to his total 
reading rate for all three purposes. 

Due to the fact that each subject read for three 
purposes, a repeated measures situation existed. 
Greenhouse and Gelsser (1959) have pointed out that 
for the usually computed F ratios of mean squares 
In the regular analysis of variance to be exactly dis- 
tributed as the F distribution, it is necessary that 
the columns or tests In addition to be Ing normally 
distributed, having equal variances, should be mu- 
tually Independent. Since the measures were made 
on the same subjects, the independence assumption 
could not be met. 

Although one approach to this problem would be 
to use a multivariate analysis of variance design, a 
simpler approach is to follow the procedure of ad- 
justing the degrees of freedom which results In con- 
servative F ratios which approximate the F distri- 
bution when the independence assumption is not met 
(Greenhouse and Gelsser, 1959). The adjusted de- 
grees of freedom are in this case land 71 respec- 
tively. Six analyses were also done using this de- 
sign and procedure. 

The second was a 3 X 2 X 2 completely crossed 
analysis of variance design with three grades, two 
sexes, two training methods and with Rlx repli- 
cates per Cdll. The model was assumed to be fixed. 
The reading variability scores were transformed by 
using the natural log to base e. Thus, the scores 
(y) used In the analysis were: 

3 

y = nat log e 2 

1=1 



After the scores were transformed, an analysis of 
variance was done on the means of the variances ac- 
cording to the procedure outlined by Scheff£ (1960) 
for the comparison of variances. Eix analyses were 
done according to these design and analysis pro- 
cedures. 

The third design was a 3 X2 X 2X3 analysis of 
variance with three grades, two sexes, two training 
procedures, and three repeated measurements or 
tests - a training test Immediately after training, a 
transfer task immediately after training, and a de- 
layed transfer task one month after training. The 
dependent variable for the analyses using this design 
was rate variability. Two analyses were done usLng 
this procedure. Conservative F te st s using the 
Greenhouse and Gelsser (1959) procedure were also 
used In this analysis. The adjusted degrees of free- 
dom were 1 and 69 respectively. For all F ratios 
found to be significant post hoc comparisons among 
the means were done following the procedures of 
Scheffe (1953). 

RESULTS AMD DISCUSSION 

The subjects consistently varied their rate when 
reading either narrative or expository material for 
three different jxirposes. The analyses summarized 
In Table 6 also show that there was a difference in 
rate variability on the immediate post training test, 
the transfer task, and the transfer retention task. 

Mean proportions of reading time are shown in 
Table 7. The trend there is clear and, with but one 
exce^ion, consistent: the childrenreadmost rapid- 
ly to find specific facts; they read less rapidly for 
main Ideas, and they read most slowly for sequence. 
The ScheffS post hoc test for multiple comparisons 
reveals significant differences between all means 
except the Post- Narrative, Main Idea, and Specific 
Fact. This is in line with the logical expectation 
that, with training, children would be able to adapt 
their rate of reading according to purpose; that they 
would be best able to pick out specific facts very 
quickly; and that the task of reading to arrange facts 
in sequence would be most time consuming because 
the subjects would need to deal simultaneously with 
several facts. 

Materials were written In narrative and exposi- 
tory styles because there was evidence that style 
affects rate. When the means in Table 7 were col- 
lapsed across style, there was virtually no differ- 
ence between the narrative and expository means 
(Expository = . 340; Narrative = . 333). Yet, a com- 
parison that takes purpose Into account, as shown 
In Table 8, reveals that style Interacts with purpose; 
expository materials are read most rapidly for the 
main Idea, but narrative materials are read most 
rapidly for sequence and for specific fact By way 
of post hoc interpretation, it would appear that the 
expository arrangement makes for more clearly 
Identifiable main ideas. Likewise, the narrative ar- 
rangement of materials would tend to have a sequen- 
tial arrangement built In and, therefore, be more 
easily Identifiable. An explanation of the more rapid 
reading of narrative materials for specific fact is 
more elusive; but it might be argued that a narra- 
tive-sequential arrangement lends clues that make 
for rapid location of facts. 
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T ABLE 8 

ONE WAV ANALYSES OF VARIANCES FOR TOTAL READING RATE FOR THREE DIFFERENT PURPOSES 
WITH EXPOSITORY AND NARRATIVE MATERIALS ON POST, IMMEDIATE, AND DELAYED TESTS 



Description 


df 


MS 


F 


Purposes on Expository Posttest 


2 ( 1) 


. 40 


40+ 


Error 


213 (71) 


.01 




Purposes on Narrative Posttest 


2 ( 1) 


. 72 


72* 


Error 


213 (71) 


.01 




Purposes on Expository Transfer Test 


2(1) 


.97 


97* 


Error 


213 (71) 


.01 




Purposes on Narrative Transfer Test 


2 ( 1) 


.92 


92* 


Error 


213 (71) 


.01 




Purposes on E <posi*ory Retention Test 


2 ( 1) 


.84 


84* 


Error 


213 (71) 


.01 




Purposes on Narrative Retention Test 


2( 1) 


.36 


36* 


Error 


213 (71) 


.01 





* p<.01 



TABLE 7 

MEAN PROPORTION OF READING TIME FOR TOTAL COMPREHENSION BY STYLE OF MATERIAL, 
TIME OF TEST AND PURPOSE 



Test and Style 




Purpose 




Main Idea 


Sequence 


Fact 


Post-Expository 


.331 


.409 


.261 


Post-Narrative 


.389 


.393 


.218 


Immediate Transfer- Expository 


.359 


.435 


.207 


Immediate Transfer- Narrative 


.348 


.438 


.214 


Delayed Transfer- Expository 


.325 


.446 


.229 


Delayed Transfer-Narrative 


.382 


. 366 


.252 



TABLE 8 

MEAN PROPORTION OF READING TIME BY STYLE AND PURPOSE 






Purpose 




Style of Material 


Main Idea 


Sequence 


Fact 


Expository 


.338 


.430 


.252 


Narrative 


.373 


.399 


.228 
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TABLE 9 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR EXPOSITORY MATERIALS AND 
POST PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


df 


MS 


F 


Grade 


2 


5.98 


2.89 


Sex 


1 


1.00 


<1 


Treatment 


1 


.65 


<1 


GXS 


2 


2. 99 


1. 46 


gxt 


2 


4.30 


2. 10 


S XT 


1 


1. 14 


<1 


G X S X T 


2 


.84 


<1 


Error 


60 


2.05 





TABLE aO 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND POST 
PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


df 


MS 


F 


Grade 


2 


3.76 


1. 52 


Sex 


1 


2.07 


<1 


Treatment 


1 


4.11 


1.66 


GXS 


2 


.64 


<1 


GXT 


2 


.23 


<1 


S XT 


1 


1. 17 


<1 


G X S XT 


2 


1.24 


<1 


Error 


60 


2.48 





The type of materials used during the training 
sessions did not make a difference In the children's 
subsequent variability rate when reading for three 
different purposes (see Tables 9-14). Children 
trained with passages containing explicitly stated 
main ideas did not differ In r a t e variability from 
children trained with mate rials with implicit but not 
specifically stated main Ideas. The types of train- 
ing materials are subsequently referred to as stated 
and unstated, respectively. The Implication is that 
materials varied on this aspect do not affect chil- 
dren's ability to vary their reading rate. Thus, 
either type of training materials should produce sim- 
ilar results if reading variability across purposes 
Is the objective of the training. 

The use of different types of training materials 
did not have any effect on the transfer task. When 
children were given an extended passage which was 
more closely related to the actual school reading 
task, children trained with stated materials did not 
differ in their rate variability from children 
trained with unstated materials. 



The same true for the transfer retention 
task. When cnlldren were tested, for retention on 
the transfer task, no differences *n rate variability 
were found between the two groups trained with dif- 
ferent materials. 

However, one might speculate that if the approach 
to Instruction had been varied for each type of ma- 
terials, the results might have been different. For 
example, If the children who worked with unstated 
materials had been trained explicitly In devising 
their own main idea statements, they might have 
done better than the other group when all bubjects 
were tested on both stated and unstated materials. 
Such speculation seems to suggest a possible next 
step for research that focuses upon training pro- 
grams for the development of rate variability. 

Whether the children were reading expository or 
narrative materials, the results were the same. 
Consistently on the post, immediate transfer, andde- 
layed transfer tests no differences were found between 
the group trained with stated main idea materials and 
the group trained with unstated main Idea materials. 
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TABLE 11 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR EXPOSITORY MATERIALS AND 
IMMEDIATE PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


d( 


MS 


F 


Grade 


2 


4.94 


2.66 


Sex 


1 


4. 22 


2.27 


Treatment 


1 


.34 


<1 


G XS 


2 


2. 35 


1.26 


G XT 


2 


2. 40 


1.29 


S XT 


1 


4.43 


2.38 


G X S X T 


2 


2.40 


1.29 


Error 


60 


1.86 





TABLE 12 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND 
IMMEDIATE PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


df 


MS 


F 


Grade 


2 


.71 


<1 


Sex 


1 


5.33 


J. 60 


Treatment 


1 


.00 


<1 


G XS 


2 


1. 51 


<1 


G XT 


2 


5. 10 


1.53 


S XT 


1 


. 32 


<1 


G X S X T 


2 


.03 


<1 


Error 


60 


3.33 





Sex did not make a difference In the r at e var - 
iability of children trained with either of the two 
types of materials. This result was consistent. 
Boys did not differ from girls In their ability to vary 
their rate from purpose to purpose immediately 
after training, on the transfer task or on the trans- 
fer retention task. 

The same results held across grade level. There 
was no difference among fourth, fifth, and sixth 
graders in reading rate variability from purpose to 
purpose on ec 2 h separate te st ing occasion. How- 
ever, the trends Indicated by the means (Table 15) 
are consistent. Fourth graders consistently showed 
more variability of r ead lng rate than d: d fifth 
graders, and fifth graders consistently showed more 
variability of reading rate than did the sixth graders. 
This could be due to the younger children’s more 
flexible mental set, which could make them much 
more susceptible to training. 

The absence of grade by treatment interaction in- 
dicates that the two different training procedures 



did not have different effects across grade level. 

This might not have been so if materials had been 
prepared for each specific grade level. Further in- 
vestigation taat focuses upon possible developmental 
trends might be worthwhile. 

The total readLng variability across occasions 
(tests) on expository materials was found to differ 
by grade (Table 16). No grade differences were ap- 
parent, however, on the total reading var iabi 1 i ty 
across occasions on narrative materials (Table 17). 

Mean rate variability by grade and type of material 
is shown in Table 18. ScheffS post hoc tests for 
multiple comparisons revealed that the only signifi- 
cant difference is between the mean scores of fourth 
and sixth graders when reading expository material. 

This supports the trend found with Individual tests. 

By way of Interpretation, the suggestion is that older 
pupils may have a fixed set for approaching the read- 
Lng task; whereas, younger pupils m ay be more 
readily susceptible to rate variability training. If 
this is so, the Implication is that such training ought 
to be given early in the intermediate grades. t 
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TABLE 13 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR EXPOSITORY MATERIALS AND 
DELAYED PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


dr 


MS 


F 


Grade 


2 


2. 97 


1.40 


Sex 


1 


. 16 


<1 


Treatment 


1 


. 27 


<1 


G XS 


2 


. 23 


<1 


G XT 


2 


.31 


<1 


S XT 


1 


. 71 


<1 


G X s X T 


2 


1. 93 


<1 


Error 


60 


2. 12 





TABLE 14 

ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND 
DELAYED PERIOD READING VARIABILITY FOR THREE PURPOSES 



Source of Variation 


df 


MS 


F 


Grade 


2 


5. 80 


2. 10 


Sex 


1 


1.78 


<1 


Treatment 


1 


. 15 


<1 


G XS 


2 


2 . 95 


1.07 


G XT 


2 


2.45 


<1 


S XT 


1 


7. 36 


2.67 


G X S XT 


2 


2.44 


<1 


Error 


60 


2.76 





TABLE 15 

MEANS FOR EACH GRADE ON EXPOSITORY AND NARRATIVE MATERIALS ON THREE DIFFERENT 
TEST OCCASIONS 



Type 


Occasion 


Grade 


Grade 


Grade 




4 


5 


6 




Post 


3. 07 


2.66 


2.08 


Expository 


Immediate 


6. 29 


6.20 


5.46 


Delayed 


6.40 


5.89 


5.72 




Post 


3.45 


3.35 


2.72 


Narrative 


Immediate 


5. 66 


5.92 


5. 59 




Delayed 


5.80 


5.61 


4. 87 
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TABLE 16 

ANALYSIS OF VARIANCE OF GRADE, SEX, TRAINING AND TEST OCCASION FOR READING VARIABILITY 
WITH THREE PURPOSES AND EXPOSITORY MATERIALS 



Sources of Variation 


df 


MS 


F 


Training 


1 


. 10 


.05 


Sex 


1 


2. 80 


1.35 


Grade 


2(1) 


13.57 


6. 49* 


Occasions 


2(1) 


36.23 


17. 32* 


T *s 


1 


.88 


.42 


TXG 


2 


3.04 


1.45 


TXO 


2 


.37 


.18 


S XG 


2 


2.26 


1.08 


S xo 


2 


1.51 


.75 


G XO 


4 


.74 


.35 


T X S X G 


2 


2.51 


L 20 


TXS XO 


2 


3.02 


1.44 


T XG XO 


4 


1.62 


.78 


S XG XO 


4 


1.49 


.71 


TXS XG XO 


4 


1.53 


.73 


Within (error) 


180 (69) 


2. 09 



* p < . 05 



ANALYSIS OF VARIANCE OF GRADE, SEX, TRAINING AND TEST OCCASION FOR READING VARIABILITY 
WITH THREE PURPOSES AND NARRATIVE MATERIALS 



Sources of Variation 


df 


MS 


F 


Training 


1 


.86 


.30 


Sex 


1 


8.61 


3.01 


Grade 


2 


7. 87 


2. 75 


Occasions 


2 


2.55 


.89 


TXS 


1 


1.61 


.56 


T xg 


2 


1. 28 


.44 


TXO 


2 


1.70 


.60 


S XG 


2 


1.24 


.43 


S xo 


2 


28 


.10 


G XO 


4 


.20 


.42 


TXS XG 


2 


2.34 


.82 


T XS XO 


2 


3.62 


1.26 


T XG XO 


4 


3. 25 


1.13 


S XG XO 


4 


1. 93 


.67 


T XS XG XO 


4 


. 69 


.24 


Within (error) 


180 


2.86 





The analyses summarized in Tables 16 and 17 
also reveal a difference in rate variability across 
tests - post- training, Immediate transfer, and de* 
layed transfer - with expository materials but not 
with narrative material. Mean rate variability by 
test and type of material is shown in Table 19. 
ScbeffS post hoc tests show a significant difference 



between the post-training and the Immediate and de 
layed transfer tests with expository material. The 
suggestion Is that not only does the ability to adjust 
rate to purpose transfer from training passages to 
more naturalistic materials, but also there Is an 
Increase In rate variability. The Increase might 
be expected on the basis that the materials in the 
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TABLE 18 

MEAN RATE VARIABILITY ON ALL TESTS BY 
GRADE LEVEL AND TYPE OF MATERIAL 







Grade 




Type 


4 


5 


6 


Expository 


5.98 


5. 65 


5. 12 


Narrative 


5.70 


5. 93 


5. 12 



transfer test equations were more nearly like class- 
room materials and less rigidly structured; there- 
fore, the subjects were better able to use their rate 
variability skill. 



It must be noted that the main effects of grade 
and test were significant only with expository mate- 
rials. Yet, the trends were generally slmLlar. The 
structure of the expository material apparently was 
more conducive to rate variability than that of nar- 
rative material. Whether this is generally so , of 
course, remains to be seen. 



There was no difference in the total reading var- 
iability of boys and girls. Boys and girls thus learn 
the same amount during the training situations. No 
differences were found on any of the Interaction fac- 
tors, which indicates that all factors were consist- 
ent in combination. 



The type of training materials used did not result 
In a difference on the total reading va r lab 1 1 it y 
across occasions regardless of whether the children 
were reading expository or narrative material. This 
again emphasizes the similar effect of either of the 
two types of training materials. It may also Indicate 
that in the future this type of research ought to be 
concerned with combinations of materials and in- 
structional procedure in order to maximize the ef- 
fect of training. 



TABLE 19 

MEAN RATE VARIABILITY FOR EACH TEST BY 
TYPE OF MATERIAL 







Test 




Type 


Post 


Immediate 


Delayed 


Expository 


4. 77 


5. 99 


6.01 


Narrative 


5.37 


5. 73 


5. 43 



FOOTNOTES 



1. The research reported herein was supported by 

the Cooperative Research Program of the 
Office of Education, U. S. Department of 
Health, Education and Welfare. This paper 
first appeared in manuscript form entitled 
“Transfer Effects of Training Intermediate 
Grade Pupils to Adjust Reading Speed to Read- 
ing Purpose, " Cooperative Research Project 
No. 3137, Committee for Research in Basic 
Skills, The University of Wisconsin, 1966. 

2. An appendix containing the directions and mate- 

rials used can be obtained from the authors 
on request. 
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Strategies for Concept 
Attainment in Mathematics 



Myron F. Rosskopf 

Teachers College, Columbia University 
New York, New York 



IT WOULD be a mistake for the writer, 
being trained In mathematics rather than psychology, 
to do basic research In conceptual learning. On the 
other hand, It Is quite appropriate for him to ac- 
quaint himself withthe results of experimentation by 
psychologists and to manipulate these results In dif- 
ferent ways to see how they apply In mathematics 
Instruction. In the latter sense, or : might say the 
paper has an operational flavor. Trat is, it dis- 
cusses ways classroom teachers might attac k in- 
struction in a specific concept ol Mathematics and 
means writers of classroom materials might use 
to Insure that provision had been made for learning 
experiences that would leadtoaf'alnment of a specif- 
ic concept. 

A teacher who faces a mathematics class five 
days each week often finds psychological research 
of very little help in solving his instructional prob- 
lems. The research, for obvious reasons, must 
start with those situations that present knowledge 
can handle. A research psychologist legitimately 
p^irsues his Interest In pure psychology; he may 
have fleeting thoughts about applications of hls re- 
search, but the excitement of carrying on investiga- 
tions in his particular field of Interest leads him to 
put these thoughts aside - temporarily, perhaps. 

Today, however, there exists sufficient evidence 
on human learning a swell as numbers of well- trained 
mathematics teachers so that applications can be 
made in classrooms. It is possible today to have 
classroom experimentation that makes use of, or 
manipulates, basic psychological research in human 
learning. Emerging among mathematical educators 



and psychologists are plans for studies that will ap- 
ply in a subject matter field the results obtained 
from the Intensive study of conceptual le a r n i ng of 
recent years (that is, since World W ar II). Every 
discipline has Its own subtleties. For this reason, 
success of such experimentation will depend upon 
facility of communication between psychologists and 
representatives of other disciplines. 

DEFINITIONS 

CONCEPT 

The word “concept" seems to have as many def- 
initions as there are writers on conceptual learning. 
Recently, a definition appeared that has the v 1 r t u e 
of efforts made to r e 1 a t e it to existing definitions. 
According to this recent statement, 

Anything that is a concept has the following 

attributes: 

I. Psychological meaningfulness 
H. Intrinsic, functional, or formal properties 

IE. Abstractness 

IV. Inclusiveness 

V. Generality 

VI. Structure 

VE. Function (KLausmeier, Davis, Ramsay. 

Fredrick, and Davies, 1565, p. 3). 

A possible criticism Is that the definition introduces 
words which in turn need to be defined. True, but 
it turns out to be easier to define (or describe) these 
new words than it was to define “concept. ” 

Two aspects of the definition that make it useful 
are its open-endedness - by means of ItemV, 
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Generality - and its own inclusiveness. Simple con- 
cepts as well as very complex concepts are possible 
of characterization by means of the definition. 

The writer has been using the followlngdefinltlon 
of a concept, probably because it lent itself so well 
to explanations of mathematical concepts. A con- 
cept is “a way of grouping an array of ob J e c t s or 
events in terms of those characteristics that distin- 
guish this array from other objects or events in the 
universe” (Bruner, Goodnow, and Austin, 1956, p. 
275). This suffices for a first level concept, but to 
obtain the complexity that we know, at least intui- 
tively, some concepts have, we need to add to the 
definition cited; and including “the network of infer- 
ences that are or may be set Into play by an act of 
categorization” (Bruner, et at, 1956, p. 244), 

We shall not stop to relate these two definitions. 
Interested readers can go to the references cited 
and see that the two do Indeed contain the same ele- 
ments. Instead we shall consider an example of a 
concept in mathematics and show in what way it sat- 
isfies the conditions of the f 1 r s t definition stated. 
Consider, for example, the set of all counting num- 
bers, or as they are often called the set of all nat- 
ural numbers, 

[l, 2. 3 n+ 1, ...). 

One can discriminate certain subsets of this set. 
There is the set of all even natural numbers, 

[2, 4, 6 2n. ...]; 

and the set of all odd natural numbers r 

[1. 3, 5 2n + 1, ...]. 

For our example of a mathematical concept, how- 
ever, we shall consider that of the set of all prime 
(natural) numbers, 

[2, 3, 5. 7, 11, 13, ...]. 

When a person can distinguish between prime 
numbers and numbers that are not prime (that is, 
that are composite ), then he lias a concept of prime 
numbers. He can demonstrate his possessionof the 
concept by filling in the next few prime numbers, or 
by devising a test for deciding whether a numbe r 
presented to him is prime, or not prime. He has 
grouped the array of objects, the set of natural num- 
bers, so that he can tell the difference between a 
prime number and a composite number. He ha s 
used the characteristics that distinguish between 
prime numbers and other members of the set of nat- 
ural numbers. Really, the person has formed two 
categories of natural numbers; those thatare prime 
form one category ; and those that are composite 
form the other category. 

At this stage of his concept of a prime number, 
a person recognizes the formal properties . He cer- 
tainly is working at an abstract level , since he is 
working with numbers, and at a level of generality , 
since many subsidiary concepts such as factoriza- 
tion, multiplication, and so on are involved. From 
the point of view of structure , the person probably 
has used a conjunction of related concept* to arrive 
at a concept of prime numbers. 

But we recognize more In a concept than just the 
forming of categories according to some discrimi- 
nating characteristic or characteristics. Part of 
the concept of prime n u mb e r s is realization that 
their number is infinite, that there Is Just one even 



prime, that no one has devised a formula for prime 
numbers, and that there are many such o pen ques- 
tions related to this interesting subset of the set of 
natural numbers. In other words, we are willing to 
accept as part of the concept these inferencesdrawn 
from the categorization. 

It seems that such associations with the set of 
prime numbers would qualify it for the attribute of 
psychological meaningfulness . There remain the at- 
tributes of Inclusiveness and function . Now, inclu- 
siveness is so much a part of specifying a set in 
mathematics that as soon as one Is able (that Is, 
correctly in the sense of mathematical criteria) to 
talk about the se: of prime numbers, the attribute 
of inclusiveness follows. Prime numbers as medi- 
ators occur in prime factorization, calculation of a 
least common multiple, and the prime factorization 
theorem of arithmetic. Hence, the concept has the 
function attribute also. 

All right. It is possible to relate wlat mathema- 
ticians call a concept to what psychologists c al L a 
concept. But a definition, If It really is adefinition 
must partition the universe of discourse into those 
things that are concepts and those things that are 
not concepts. A ‘‘definition” that Is al 1 Inclusive 
might just as well not be stated at ail. In short, It 
must be possible to point to something In mathemat- 
ics that is not a concept. But that Is easy; any addi- 
tion tact, such as 5 + 4 = 9, is not a concept. 

CATEGORIZING OR CONCEPTUALIZING 

The word “category” was used In the preceding 
discussion. What Is Involved In categorizing? How 
is It related to conceptualizing? More Important, 
how Is categorization related to the use of concep- 
tualization in applications, or problem solving, In 
mathematics? First, let us analyze another exam- 
ple of a mathematical concept and, second, derive 
from the discussion of the example what seem to be 
characteristics of categorizing. 

Consider the concept of a rational number. Its 
formation starts very early In the home experiences 
of a preschool child. One-ha if and one-fourth are 
known for names of parts of things; one-half of an 
apple or an orange or a glass of juice or a candy bar. 
During early schooling, the concept is expanded to 
include written symbols for one-half and one- fourth: 
1/2 and l/4; 1/3 also is added to the list. However, 
the concept is still on the level of these symbols be- 
ing names for parts of things. There seems little 
evidence that a child thinks of 1/2, 1/4, 1/3 as ex- 
emplars of a new sort of number. The teacher may 
call these fractions rames for numbers, of course, 
but still the concept, the way of categorizing these 
numbers, of telling how they differ from other num- 
bers, Is in terms of a way of expressing them; to 
wit, a numerator, a horizontal bar, and a denomi- 
nator. 

Not until quite late does the Instruction reach the 
stage of giving a new name, rational numbers, to the 
set of numbers that can be expressed as thequotient 
of two Integers, the denominator not zero. Now the 
concept has formal properties; it has been formal- 
ized, one might say, and It will be even more for- 
mal (that Is, abstract) when a student recognizes 



60 



RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 



rational numbers ab ordered pair s of Integers In 
which the second member is not zero. 

At each level of formality, there are cues that a 
student looks for: 1) one of two congruent parts of 
something, such as an apple; 2) a numerators hor- 
izontal bar, and a denominator; 3) a quotient of two 
Integers; and 4) an ordered pair of Integers. These 
cues help a student put a number he encounters Into 
its proper category, to align It with the concept he 
has formed of the set to which that number belongs. 
Notice, too, that the Invention of ways of grouping 
predictive characteristics Is Involved; for example, 
the numerator, horizontal bar, and denominator. 
The test of the Invention Is its usefulness. Does It 
effectively categorize numbers? 

Categorizing has for its basis defining character- 
istics. By grouping together things that satisfy the 
defining characteristics of a class, an individual a) 
reduces the complexity of his environment; b) iden- 
tifies the objects Ln a particular universe of dis- 
course; c) reduces the necessity for constant learn- 
ing; d) gives direction to activity; ej orders and re- 
lates classes (Bruner, etal. , 1956, pp. 12-13). 

What are the implications for problem solving In 
mathematics? If a student does not classify prob- 
lems he meets, then he must treat each problem as 
an individual. The cognitive strain in such a proce- 
dure is enormous. The student must, perforce, for 
purposes of economy of effort look for distinguish- 
ing characteristics or discriminate attributes of 
problems in order to reduce the strain. That is, he 
must use cues, put the problem In a pre-d e c id e d- 
upon category, and bring into play concepts that in 
the past have been effective in solving problems of 
this particular category. It would seem that a cate- 
gorization of a problem is the first step toward its 
solution. Only after a problem ha s been putlna 
certain category can one proceed with plans for 
solving it. 

Of course the first plan chosen may f all . If it 
does, a person has to devise variations on the first 
plan. Perhaps he failed to discriminate carefully 
enough when he categorized the problem. In other 
words, taking a first step toward Its solution, leads 
him to recategorize the problem. The Important thing 
la that he must realize that the Initially chosen method 
of solution fails and then search for a new method. 
He must shift his plans, and this requires strategy. 

STRATEGIES IN 
CONCEPTUALIZATION 

STRATEGY 

A strategy is a carefully planned calculation and 
coordination of the specific ends and means neces- 
sary to achieve a goal. That is, as in the following: 
A strategy refers to a pattern of decisions 
in the acquisition retention, and utilization of 
Information that serves to meet certain objec- 
tives, L e. , to Insure certain forms of outcome 
and to Insure against certain others. Among 
the objectives of a strategy are the following: 

a. To insure that the concept will be at- 
tained after the minimum number of 
encounters with relevant Instances. 



b. To insure that a concept will be attained 
with certainty, regardless of the number 
of instances one must test en route to at- 
tainment. 

c. To minimize the amount of strain on In- 
ference and memory capacity while at 
the same time insuring that a concept 
will be attained, 

d. To minimize the number of wrong cate- 
gorizations prior to attaining a concept. 
(Bruner etal., 1956, p. 54.) 

The preceding definition of a strategy and a de- 
scription of the aims of a strategy is very similar 
to the mathematical definition of a strategy that Is 
associated with the theory of games. However, the 
theory of games strategy consists of a s e t of deci- 
sions made in advance. Once the decisions are 
made, no change can be made while “play 'Ms going 
on. In contrast, a problem-solving strategy, for ex- 
ample, may be changed In the midst of a subject's 
efforts; such changes are dictated, or shouldbe dic- 
tated, as the subject’ 8 knowledge of the problem 
grows through his efforts to find a method of solution. 

TYPES OF STRATEGIES 

“Virtually all the effective strategies for attain- 
ing concepts i pend upon the use of son e sort of in- 
itial focus ,” (Bruner, etal., 1956, p. 63). How 
does the subject perceive the situation? What as- 
pects of it holds his attention? How does he define 
the task to himself? If the task is a problem situa- 
tion, what data seem to be most relevant? How 
does he fit this problem Into his concept pattern of 
all types of problems with which he has had experi- 
ence? After making an Initial focus with respect to 
the problem, a subject stkll faces the necessity for 
decisions concerning a method of attack. What sort 
of strategy should he decide upon? According to 
Bruner and his associates there are four ideal strat- 
egies: a) simultaneous scanning; b) successive scan- 
ning; c) conservative focusing; and d) foe us gambling 
(Bruner, etal., 1956, pp. 83-90). 

a) Simultaneous scanning . The s im u ltane ous 
scanner forms many possible hypotheses to follow 
toa solution and keeps all of these hypotheses in 
mind. The strain on memory Is great. Initially, he 
chooses one of these hypotheses and tests it to see 
if It Is promising and at the same time to see which 
of the other hypotheses It eliminates. A subject us- 
ing this strategy has to keep all of the hypotheses in 
mind; he has to deduce which are eliminated, and as 
he proceeds to test a remaining hypothesis, he must 
remember which hypotheses were eliminated by his 
earlier testing. 

The critical point In simultaneous scanning de- 
pends uoon a subject's ability to deduce all the In- 
formation with respect to which hypotheses should 
be discarded from the testing of an Initial hypothe- 
sis. If he can do this, then he can proceed with 
maximum information to test a remaining hypothe- 
sis. However, memory strain and the factor of 
time usually prevent him from obtaining maximum 
Information. Suppose the subject makes a wrong 
deduction? Does he have control over this risk? He 
does not; he cannot himself either Increase or de- 
crease the risk. 
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b) Successive scanning . Essentially, this strat- 
egy consists of testing one hypothesis at a time. A 
hypothesis Is tested until a contradiction is reached, 
or until it is clear to the subject that the desired In- 
formation is not forthcoming. Then the hypothesis 
Is discarded, and a second is chosen for t e st ing . 
Notice that a hypothesis is tested independent of the 
others. 

The gain in use of successive scanning is twofold: 
1) it lightens memory load and 2) frees the subject 
from the necessity for making many deductions con- 
cerning the other hypotheses. Two disadvantages 
are that some of the hypotheses may overlap, lead- 
ing to repetition of work already done, and that there 
is no control over risk. Asubject cannot take 
greater gambles or lesser gambles. This is a rath- 
er leisurely strategy and discounts heavily any time 
factor. 

c) Conservative focusing. First of all, a subject 
who Is a conservative focuser studies the situation 
to see if there is one key Idea. If there is, it Is fo- 
cused upon, and all hypotheses are tested against it. 
Suppose he finds a hypothesis that looks promising. 
That is, a hypothesis that impinges on the key idea. 
Now, he chooses those hypotheses that contain the 
same part that the promising hypothesis does. Then, 
one by one, he adds parts of these hypotheses and 
tests the results. The “conservative” enters this 
strategy at this point. Only one feature of a hypoth- 
esis is added at a time and tested. 

Much Information is obtained by conservative fo- 
cusing and redundancies are avoided. The risk of 
securing no Information is uider control; In fact, 
one always gets some useful information. The only 
real disadvantage Is that information which is not 
arranged in orderly fashion might involve a long 
search for the needed data. Thus, part of the suc- 
cess of a subject uslngconservatlve focusing depends 
upon how well organized his knowledge is. 

d) Focus gambling . The Initial steps taken by a 
subject who uses focus gambling as a strategy are 
the same as those of one who uses conservative fo- 
cusing. But, he is not satisfied with adding one part 
of a hypothesis at a time and testing; he addstwoor 
more parts at a time and gambles. The strategy is 
not quite an all-or-nothing one, but It comes very 
close In case the omnibus hypothesis falls. The 
only thing to do then is for the subject to shift strat- 
egies and fall back on successive scanning. 

However, the gamble may pay off. The omnibus 
hypothesis may lead to attainment of the objective. 
There Is much gain then, of course, for the number 
of trials has been reduced to a minimum and much 
time has been saved. 

THE STRATEGIES IN USE 



IMPORTANCE OF INITIAL FOCUS 

Several years ago, the writer did a pilot study In 
which about ninety secondary- school teachers were 
involved. Two tasks, or problems, ware presented 
to the subjects, and they were asked to f ind a solu- 
tion. The objective at the time was to secure Infor- 



mation on these teachers' concept of a mathematical 
solution, but other Interpretations of the evidence 
turned out to bo more interesting. This is true, par- 
ticularly in view of the foregoing discussion. 

Situation 1, One problem w?s the following: 

From a two-digit number, N, subtract the 
number whose digits are those of N inter- 
changed. If the difference Is a positive cube, 
how many permissible values of N are there? 
However innocent this problem appears, it is not a 
run-of-the-mill problem. The method of approach, 
that is, the initial focus, is critical. Practically all 
of the teachers classified the problem as a 1 'digit 
problem.” All right; t he r e are standard methods 
for solving a problem so categorized. These were 
applied; let t and u represent the tens’ and units' 
digits, respectively; then 

N = lOt + u 

a positive perfect cube * (lOt + u) - (lOu + t). 

Quickly perceived Is that the tried-and-true meth- 
ods fail. There is no place to go from th 1 s point, 
for at least two more equations are needed for them 
to be successful. A small number of papers were 
discarded because of errors In finding a simpler 
form for (lOt + u) - (lOu + t). It Is doubted that this 
was failure of any strategy. Rather, such errors 
seemed to be the result of haste or carelessness. 
The remaining papers fell nicely Into three groups. 

There were those whose Initial foe u s was all 
right. These papers showed that the persons got as 
far as 

N- » lOt + u 
x>= 9{t - u) 
x > 0. 

But, unfortunately, once they had made a focus, they 
were not flexible enough to change It when It led no- 
where. The papers of these subjects were covered 
with equations and tag e nd s of scribblings. They 
formed only one hypothesis - secure enough equa- 
tions to solve for all of the unknowns. One might 
categorize their strategy as successive scanning, 
where there was just one hypothesis to scan. This 
was done over and over by members of this group. 
There was no change of focus with respect to the 
problem. Failure did not discourage them from try- 
ing the same hypothesis again and again. 

The second group's paper3 showed fewer scrib- 
blings. There was hardly any writing on t he s e pa- 
pers after the initial symbolizing of the problem sit- 
uation. Inferred from what evidence was available 
was that these subjects realized that the initial cat- 
egorization of the problem as a digit problem was 
not quite correct. The/ seemed tobe flexible enough 
in their focusing on the problem to change their fo- 
cus. It seemed, however, that they were at a loss 
to formulate another hypothesis or another strategy. 
A possible interpretation is that these people had a 
limited concept of a mathematical solution. Geomet- 
ric proofs and the results obtained by solving equa- 
tions qualified all right, but the result found by trial 
and error or by a verbal argument did not. 

Members of the third group not only realized that 
a shift in initial focus was necessary but they also 
had a better conception of what constitutes a mathe- 
matical solution. Some adopted astrategjof 
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successive scanning, trying different pairs of num- 
bers in succession. Others ciearly used conserva- 
tive focusing, for they not only tried pairs of num- 
bers but also took Into account the positive perfect 
cube datum. Those with the most elegant solutions 
used a highly sophisticated conservative; focusing 
strategy. A few used focus gambling, but more due 
to the pressure of time rather than to preference. 

Situation 2, The second task presented to these 
teachers was a straight-forward geometry problem: 
Find, on a straight line, a point such that 
the sum of its distances from two given points 
is the least possible. 

The first step in any geometry problem is to draw a 
figure and Introduce some notation. If more sub- 
jects had followed this advice, there would have been 
more correct solutions to this problem. As it was, 
only one-sixth of the subjects were able to arrive at 
a solution. Just as was the case with the algebra 
problem, here, too, the difficulty was inflexibility 
with respect to the initial focus. 

Let us take the key idea of the problem, the sum 
of the distance from two given points 1 e t h e least 
possible, and use it as an initial focus. Now, as one 
proceeds to make a figure and introduce notation, he 
must give 

<7 1 5 > 

Case 1 

up this initial focus for a moment and shift to focus- 
ing on the two given points. The problem says noth- 
ing about placing them; a decision is required. 
Three possibilities, or hypotheses, appear: Case 1, 
both points are on line* ; Case 2, the points are on 
opposite sides of* ; 



triangle BDC is congruent to t r i a n g 1 e B ' DC, and 
consequently BD a B'D. Therefore, BD + DA Is the 
least possible distance. 

These two problems have emphasized the impor- 
tance of initial focus. More tnan that, discussion of 
attempts at solutions made clear how necessary it 
is for a problem solver to be flexible enough to shift 
his focus as the process of solving the problem de- 
velops. In each problem, concepts related to t h a t 
Involved in the problems themselves were very im- 
portant. It seems that, at least in m ath e mat ics, 
knowledge of these subsidiary concepts is crucial to 
success. The strategies used seemed first to be 
that of simultaneous scanning with a transfer to con- 
servative focusing after a promising * 1 le ad * ’ had 
been discovered. 

SIMULTANEOUS OR SUCCESSIVE SCANNING? 

The next problem situations are relatively inde- 
pendent of initial focus, depending much more upon 
a choice of strategy. The mathematics curriculum 
puts considerable emphasis today on a search for 
patterns. The following situations are of that sort. 

Situation 3. Divide your paper into three columns. 
In the first column there Is a string of letters, and 
In the second column there is another string of let- 
ters. Now, we shall use these two strings of letters 
to make a new set 

K, L,M, T,W, Z j L,M,T,X,Y | 

of letters In the third column. How were the letters 
In the third column 

K,L,M,T,W,Z | L,M,T,X,Y | L,M,T 



A* 



< 






> 



• B 

Case 2 



and Case 3, the points a/e on the same side of A . 



A* 



• B 



Case 3 

A shift of focus back to the least possible distance- 
focus immediately takes care of Case X and Case 2, 
for the shortest distance between two points is the 
length of the segment joining them. Now, keeping 
these results In mind, turn to Case 3 and ask “How 
can I use this idea (the length of the segment) A 
few moments’ thought suggests reflecting one of the 
points in the line A- , yielding point B f . Segment AB 1 




obtained? Now, try to write the set of letters that 
goes into the third 

A,C,E,P,Q | A.C.L.P.Q.R.S | 

column for these two sets. What goes into the third 
column for the following two sets ? 

T.U.V.W | T,U,V,W | 



Here is another example. What would you write in 
the third column? 

S,A,M,E j N.O.T | 

Is it true that, given sets in the first and second 
columns, there is always exactly one way to do the 
third column? 



What are the results if we Interchange the sets 
in the two columns? Fill in the third column and 
compare the results with what you got before. 



L,M,T,X,Y 
A, C, L, P,Q, R,S 
T, U, V,W 
N,0,T 



K,L,M,T,W,Z 
A,C,E,P,Q 
T, U,V,W 
S, A, M, E 



intersects A in D, and D U the desired point. Fcv 



What did you find? 
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Situation 4 . Now let us form a third column set 
In a different way. As before, we start wlthsets in 
the first and second columns. How was the 

A,C,E,G,H,J J B,C,D, E, F,G, T | A,H,J 

third column set obtained? Now, try to write the 
third column set, starting 

F, A, M, I, L, Y | E, A, R, L, Y | 

with these two sets. I^et us try two more special 
situations. Is it always 



A, B,C, I D,E, F,G I 

A, B,C, D I A, B,C, D | 

possible to obtain exactly one set, given sets In the 
first and second columns? 



Let us 6ee what the results are U we Interchange 
the sets In the two columns. Compare the answers 
with those you had before. What can you say? 



B,C,D, E, F,O t T 
E,A,R,L, Y 
D,E,F,0 
A, B,C ( D 



A,C, E,0, H, J 
F, A, M, I, L, Y 
A, B, C 
A,B.C,D 



We have worked with strings of letters In two dif- 
ferent ways. That is, we used two different pat- 
terns to certain the set in the third column. Compare 
these two patterns. Do they have the same proper- 
ties? How are they different? 

DISCUSSION OF SITUATIONS 3 AND 4 

The last two problem situations are quite differ- 
ent from the first two. Except that they we r e not 
quite *tr Ight- forward, the first Uo problem Situa- 
tions are representative of the mathematics program 
before World Wvr 11. The lest two are representa- 
tive of types of problems that ailse in the new math- 
ematics program. The algebra and geometry prob- 
lems have for their objective getting an answer. Af- 
ter the answer has been obtained, there Is little one 
can with it, except perhaps to refine the method 
o* solution It la not so much that a concept Is In the 
process of being attained as It is that pre-estab- 
llihed concepts serve as mediators In solving each 
problem, Consequently such problems wouMbe rea- 
sonable to present only after there wassome evi- 
dence that subjects had been at least exposed to the 
necessary mediating concept*. 



On the other hand, the third and fourth problem 
situations are representative of situations intended 
for seven- to nlne-yiar-okJ subjects. The Intent Is 
that through such situations a foundation Is laid for 
attaining rather deep mathematical concepts - those 
of closure and commutativity In (Ms case. A battery 
of situations of this sort can be devised that has a 
bearing on ordinary arithmetic. Of tout as, letters 
would not have to be used. One could use the boys 
and girls In a class, or colored counters, or books, 
or any other sort of material available. An effort 
would be made to use materials appropriate for the 
age level of the class. 

R is not clear to the writer that mediating con 
cepts are brought Into play. Rather, It seems that 



solving these problem situations requires use of a 
strategy, one that is effective In attaining concepts. 
Pattern-problems such as these seem to yield to a 
successive scanning or a simultaneous scanning 
strategy. Or, one uses a combination of t he two 
strategies; simultaneous scanning for gross elimi- 
nations of parts of the strings of letters; and suc- 
cessive scanning for determination of fine discrimi- 
nations. 



TWO ITEMS OF RESEARCH 

Important to tne mathematics program Is knowl- 
edge concerning what types of data In problem situ- 
ations present difficulties. Such knowledge influ- 
ences preparation of classroom materials In two 
ways. Learning experiences c an be provided that 
are intended to facilitate attainment of a c o nc e pt , 
and Information gleaned from research studies can 
be used to schedule concepts according to age levels. 

An attempt by one person to report on all of the 
research studies concerned with problem solving 
would W; foolhardy. A bibliography is ve ry long. 
Two doctoral studies have teen singled out for re- 
porting. One reason Is to underscore the tact that 
much relevant research gets lost or overlooked 
through non- publication In Journals. 

POST STUDY 

tn 1958, Post did an experimental study of six fac- 
tors involved In understanding problems. His sub- 
jects were fifth- and sixth-grade fxjpils in schools 
In the Metropolitan New York section of the country. 
The definition of a problem In the study was r, a quan- 
titative situation detcrlbed in words ... but in which 
the arithmetical operations that lead to the answer 
to the question are not explicitly Indicated" (Post, 
1958, p. 15). The six factors were: 1) sire of cum- 
bers; 2) superfluous numerical data; 3) familiarity 
of setting; 4) number of steps; 5) type of operation; 
and 6) symbolic terms. 

Factor 4, number of steps, requires some words 
of explanation. Post defined a two- step p r o b I e m 
and a three-step problem as fellows: 

A step In a problem solution . . . was a 
simple performance of o,>e of the four oper- 
ations of addition, subtraction, mull ipl Nation, 
and division. Therefore, a problem Is (a two- 
step problem) if and only If the solution of the 
problem requires a single performance of /wo 
different operations or two performances of 
the same operation fPost, 1958, p. 30). 

A three-step problem Is defined In a similar way. 

Factor 8, symbolic termr, refer* to the question 
of whether using a name for a nu mbe r such as 
"twenty* six" in place of r, l8" Interferes wltha sub- 
ject’s ability to solve a problem. The names of 
the other factors are self- explanatory. 

Two forms of a test were prepared by Post; these 
forms were judged equivalent by s j u r y of experts 
and then tested further In a ptk* study. FamllUrl y 
of setting and non- familiarity of setting was obtained 
from an Inventory of such settings suggested by ele- 
mentary- sc bvl teachers. This Information w a s 
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supplemented with evidence obtained from the pilot 
study pupils. 

The study design was such that an analystsofvar- 
iance technique could be used. The error term 
“was composed of the unconfounded four- and five* 
factor interactions as well as the slx*factor Inter* 
action” (Post, 1056, p. 65). The two forms of the 
test were treated as two replications of the same ex- 
periment, for examination of the test results from 
the two forms led to doubt that the data from them 
could be combined. The schools represented two dif- 
ferent socio-economic neighborhoods; the subjects 
were chosen from non- homogeneous classes; and 
small sample theory analysis was used. Correct* 
ness of solution was determined from examination 
of the work written by a pupil rather than from the 
correctness of tho answer. For example, a pupil's 
solution might be categorized as correct even If his 
answer was incorrect. Another way of saying this 
is that errors in arithmetic computation w e t e dis- 
regarded. 

A hypothesis was rejected if the r e s u 1 1 s from 
both forms of the test indicated rejection; It was ac- 
cepted, similarly, if both forms Indicated acc e pl- 
ane e. No conclus'.:ri could be stated if one form in- 
dicated rejection and the other form indicated ac- 
ceptance. 

The hypotheses on the factors of size of numbers 
and number of steps fell In the no conclusion cate* 
gory. So far at the latter (number of steps) Is con- 
cerned, It might have been that there was a strong 
Interaction between number of steps and type of op- 
eration, for the hypothesis concerning the latter was 
rejected at the one tenth of one percent level of sig- 
nificance. That Is, problems involving multiplica- 
tion and division were found to be more difficult for 
the sample subjects to understand than problems In- 
volving addition and subtraction. 

Hypotheses rejected were those concerning super- 
fluous numerical data, familiarity of sett! ng, and 
the already mentioned type of operation. The hy- 
pothesis concerning symbolic terms was accepted, 
tn short, expressing numerical data in words or in 
digits had no effect on pupil's understanding of such 
problems. 

BECHTOtf) STUDY 

The I HI study of Bechtokl consisted of s compar- 
ison of an experimental group with a control group 
In which the t>fmer received Instruction In work 
with problems containing superfluous data and the 
Utter did t»L Two units from the ninth-year pro- 
gram, inequalities and applications of equations to 
falltr* body problems, were chosen for Instruction 
and testing. The srtjects were 14- to lS-year-old 
students In New York City and the ear rounding Met- 
ropolitan region schools. 

The hypothesis that Instruction in handling prob- 
lems containing superfluous data (tn both Inequality 
and falling body problems) had no effect cm develop- 
ing problem- solving ability waa rejected si the one 
percent level of significance. The results with re- 
spect to variables of sex, intelligence, and age In- 
dicated no significant differences with r es peel to 



sex and Intelligence. The data indicated, however, 
that younger students seemed to benefit more from 
Instruction than older students. 

RELATION OF THE POST AND BECHTOLD 
STUDIES TO CONCEPT ATTAINMENT 

It Is clear that If there is such a thing as a con- 
cept of problem solving, then It Is a very complex 
concept. Moreover, success with problem solving 
Is dependent upon mediating concepts that in them- 
selves are complex. The studies of Post and Bech- 
told, for example, underscore the importance of In- 
struction, of exposure of pupils to m a ny different 
sorts of problems or learning experiences In order 
that they have opportunities to attain necessary sub- 
sidiary concepts. 

The fact that familiarity of setting and superflu- 
ous dzta were significant factors tn Post * s study 
seems to indicate that pupils may have had no pre- 
vious encounters with such problems. Hence, they 
would have had no opportunity to form a concept of 
such problems, that Is, to categorize them and de- 
velop strategies to use in their solution. Since mul- 
tiplication and division in problems turned out to be 
significantly more difficult to understand than addi- 
tion and subtraction, one infers that pupils do not 
conceptualize the former ts weP as the latt er. It 
may be that the methods of teaching used with mul- 
tiplication and division failed to develop firm con- 
cepts. As a result, pupils were unsure In their cat- 
egorizations when these operations were present In 
problems. 

Bechtcld established that Instruction in how to 
handle problems containing superfluous data led to 
greater success with such problems than that of a 
control group - at least for ninth-grade algebra stu- 
dents. A teacher Is prone to extrapolate from this 
evidence and conclude that such instruction, appro- 
priately designed, U good for almost all age levels. 
Although the study does not represent condos Ive 
ovKence, still It Is encouraging In that statistically 
significant dwlerences resulted. So often an exper- 
iment that compare i two procedures W Instruction 
ends with one group doing about as wellasthe other 
on tests; there are no statistically slgr tf leant differ- 
ences In the two sets of results. The unexpected 
significant differences In Bechtold's study leads one 
to go beyond the statistics and say that experience 
with the r nt lysis of problems with superf lu?us data 
significantly affects outcomes. 

From the definition of a concept given at the be- 
ginning of this paper, one tees that a pe eon d o e • 
not form a concept just through maturation. There 
coast be experiences In his environment that make 
hit attempts to understand the environment loo com- 
plex unless be forms classes - unless he cooc equ- 
alizes. This is particularly true of mathematics, 
one of man's sophisticated Invent ions. Re r haps a 
thlh) develops "natur ally M some concept of count- 
ing, even Inventing Ms own tames In tome In- 
stances. But as there are encountered larger and 
larger groups, the effort to ism ember number 
names becomes too much, and, tf Msiorka) evi- 
dence la valid, there is a tom tar toward forming 
classes, groupings, and a wumera 1 system la born. 
From this point on, present day culture dictates 
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that Intensive exposure to a variety of experiences 
must leap-frog the historical pattern of development 
in mathematics. These learning situations cannot 
be left to chance; they must be provided; and they 
must be planned carefully. Experimental evidence, 
both in the field of psychology - learning theory - 
and mathematical education, furnishes guidelines for 
such planning. In turn, experimental evidence af- 
firms or denies that the planning is effective. The 
Post and Bechtold studies are examples of this two- 
pronged approach to a mathematics curriculum. 

SUMMARY 



So It Is that human beings t e nd to deal with 
classes of things Instead of Individuals in order to 
make some sense out of their environment. By form- 
ing such classes cognitive strain Is reduced as well 
as the burden on memory. To form these classes, 
or categories, or sets, a person looks for cues, or 
if you like, for characteristics that serve to distin- 
guish things eligible for member ship in the set from 
those that are not eligible. The point is that these 
categorisations are Inventions, and this la particu- 
larly true In a complex body of knowledge like math- 
ematics. 

To solve a problem In mathematics, subsidiary 
concepts serve as mediators. A It ho ugh in It la Hocus 
and type of strategy have Important roles, an indi* 
vtdual will have little success In problem solving un- 
less he has a firm grasp of the mediating concepts. 
Mathematical education speaks In terms of a student 
mistering a concept so that it Is a part of himself; 
a psychologist would apeak in terms of a student In- 
ternalising a concept. No matter what language one 
uses, it is certain that some of the failures in math- 
ematics instruction are due to an Instructor assum- 
ing his students have understood a mathematical con- 
cept at a high level of operational thinking when in 
reality they have a much lower level of mastery. 
They cannot apply the concept in an unfamiliar set- 
ting. As experimental evidence accumulates from 
Investigations of how people learn and from studies 
in a curriculum context, mathematical educators 
are on the one hand becoming more cautious and on 
the other more daring. Allying the evidence, they 
have chinged the content of the curriculum and re- 
duced the amount of pure drudgery that used to be 
the lot of every mathematics student Assessing re- 
cent evidence, they have some doubts whether all 
students master the ear ly Introduction of concepts. 

Already said la that people categorise the things 
In their environment A categorisation might result 
tn in Initial focus on a problem, f hen certain hy- 
potheses ire formed thit are related to this initial 
focus. Decisions on these hypotheses serve to val- 
idate the hypotheses. 

The sequence of decisions made bv the per- 
son en route to attaining the concept [which 
may be a problem solution or a patters] , . . 
may be regarded as a strategy embodying 
certain object Ire a . These objectives may be 
various in k ind but in general one may distin- 
guish three kinds cf objectives: s. to mul- 
mUe the Information gained from each deci- 
sion and test of an Instance; b. to keep the 
cognitive strain Involved in the task within 



65 



manageable or appropriate limits and certainly 

within the llm f ts imposed by one's cognitive ca- 
pacity; and c. to regulate the risk of falling to 

attain the concept within a specifiable time or 

energy limit. .* (Bruner, et al. , 1956, p. 234). 

In the examples presented of problem solving or 
rtf attaining a concept In mathematics, the idea of 
Initial focus and flexibility with respect to one’s fo- 
cus Is of great importance. After isolating a key 
idea in a problem, a student has a choice of strate- 
gies - simultaneous scanning, successive scanning, 
conservative focusing, or focus gambling. A skilled 
problem- solver probably uses a combination of si- 
multaneous scanning and conservative focusing. A 
beginner Is likely to use successive sc annl ng. If 
time harasses a problem- solver, there is nothLng to 
do but turn to focus gambling as a strategy. The sit- 
uation and the Individual (his own experiences, bat- 
tery of concepts, and psychological make-up) deter- 
mine which strategy will be used. 

The Investigations of Dienes (1963) at Harvard as 
well as that of Dienes and Jeeves (1965) in Australia 
lean heavily on the work of Bruner and Piaget. How- 
ever, their work goes beyond that of their predeces- 
sors, making use of new research results tnd sug- 
gesting refinements of the theory of learning upon 
which Bruner based his work. An kies that Dienes 
and Jeeves, separately and together, experimented 
with la the development through <r mathematical 
games" of the concept of isomorphism of structures. 
Involved here la the recognition of patterns and no- 
ticing the similarity between two sets of d at a and 
the structure that can be applied to both. 

Suppes (1965) has done a great deal of work with 
the major emphasis on learning models for relative- 
ly non-complex mathematical concepts. He charac- 
terUes his vork by ssylng that It is based upon a 
stimulus- sampling theory. An Interesting assertion 
is that the hypothesis -strategy language of Bruner 
and his associates can be related to stimulus- sam- 
pling terms : . a strategy . . . corresponds pre- 

cisely to a state of conditioning and a hypothesis to 
the conditioned stimulus sampled on a given trial 
..."{Suppes, 1965, p. 65). 

Some psychologists dojbt the value of a mat he- 
matics! psychology approach to models for human 
learning, but there is no disagreement that much 
work needs to be done with complex concepts tn or- 
der to learn mere about Individually different ap- 
proaches to attaining thematic a l concepts^ Mean- 
while, the mathematical ’due ator mates use of 
available knowledge, apples It as best be can to the 
mathematics program, and gathers experimental 
evidence to see the effect St is Impossible to watt 
trtti) definitive psychological research on learning 
has been done, for the curriculum exists and most 
be modified to fit twentieth century activities. One 
implication is clear: new psychological e vide nee 
should be brought to bear on the curriculum as 
quickly as possible. It Is Is the latter direction that 
mathematical education Is turning. 

NOTE: Situations 3 and 4 are modeled after similar 
materials that appeared in the Nuffield Foundation 
Mathematics Teaching Project Bulletin No. 1. Nov- 
ember 1964, pp. I-?” 
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Instructional Materials and Media 



PART III 




THE MEDIUM of instruction con be considered as the interface between 
the learner and the subject matter being learned. It necessarily affects the rate of 
learning and imposes limitations on the scope and sequence of the instructional sub* 
ject matter. Instruction by television has been criticized as impersonal and encourag* 
ing passivity. Yet, according to Wilbur Schramm in "Instructional Television Around 
the World" instructional television con, when properly used, provide for active 
learning experiences. In a series of case studies, Schramm reports on the use of 
television in widely varying sections of the world — from the affluent suburb to 
the developing nation. Properties and attributes of the media are discussed with 
reference to the school system, the teacher, and the student. Television is exam* 
ined as a potent mechanism of change. Schramm concludes that this medium 
works best when it is integrated into an instructional system which includes special* 
ized materials, activities, ond teaching tec'miques. But the key to the system is 
a local supervisor through whom students can interact with one another. 

Research dealing with the process of instruction is examined by Arthur 
lumsdaine who points out that problems associated with instruction are in fact 
inseparable from problems dealing with learning. Tho close relationship between 
research on instructional media and the more general field of basic psychology 
of learning must be understood by persons purporting to do research on instruc* 
tional media. Among the general areas identified for research on the effects of in* 
struction is the "far underdeveloped research field of constructive and imagina* 
five attempts to improve on the basis for determining what ought to be taught." 
lumsdaine argues that determining the effects of present instructional media should 
precede the "more elegant question of what specific variables account for these 
effects." He takes the position that effective instructional media are a prerequi- 
site to meaningful basic research on these medio. This implies programs of devel* 
opment before research and suggests a basis for priorities in research and develop- 
ment. "Only when something effective has been developed, do we then have an 
adequate tool with which to conduct useful research." 




The question of cost efficiency which is usually not considered by 
educators is explored. Such efficiency frequently implies a measure of the level of 
proficiency achieved for a given effort with, as lumsdaine suggests an approach 
in which the lime required to achieve a given minimum level of proficiency is used 
as the dependent variable. Such a proposal hos significant implications for the 
design of instructional objectives and instructional research as applied to selected 
subject areas. 

Lumsdaine concludes with a discussion of the standards or lack of 
standards used in the design and reporting of research studies dealing with instruc- 
tional media. 

Matching the instructional strategy to the capabiliti <s of a learner re- 
quires a tutorial model of instruction. Lawrence Slolurow proposes an instructional 
system in which methods and materials are individualized for the learner on the 
basis of the continuous matching of methods and materials with the aptitude, 
personality, and knowledge of each learner through the use of feedback contin- 
gencies both prior to and during instruction. Such individualization can be achieved 
only in Computer Assisted Instruction. Stolurow summarizes a general idiogrophic 
contingency model of a cybernetic, computer based instructional system colled 
SOCRATES. "It (this model] is based on the assumption that individualized instruc- 
tion should take a prescriptive-corrective approach to the use of psychological 
information in making decisions about teaching in a tutorial context." The logic 
of instruction i.* determined according to certain rules whose application is con- 
tingent on variables monitored throughout the instructional sequence. Results 
bosed on the idiogrophic model are presented with reference to the kinds of de- 
cisions made in individualizing instruction via the computer. 
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Instructional Television 
Around the World 



Wilbur Schramm 

Stanford Unlvmi*y 
Stanford, California 



WE HAVE now in hand tb'i largest 
body of comparable and detailed data yet assembled 
on Instructional television throughout the world: 
twenty-three case studies of the use of new educa* 
tlonal media In eighteen countries, most of them in* 
eluding television* 1 I will review th r e e of these 
cases In some slight detail, cite * few others, a nd 
then try to sum up what 1 thUk the studies say about 
the requirements for using Instruct tonal television 
effectively* 

One point I shall not belabor Is that instructional 
television, used well, clearly does work. U works 
over a wide spectrum of tasks and a variety of situ* 
atkms. ft works in developing countries and coun- 
tries that are highly industr la'ited. It works some* 
times very well and sometimes ordinarily. To tllus* 
tr ate what these cases say about bow It works and 
under what conditions It appears to work well, twill 
enumerate three Instances. 



CAM t. SAMOA 



The story of Instructional television In Simoi 
really beglna with the appointment of atovgh, deter- 
mined, little governor, H. Rex Lee, in mi, butt re 
whole story la GO years older than that, and deals 
mostly with American neglect of Its wards on the 
Samoa Islands. The school system was o ». 'f one 
symptom of that neglect, but ft was a vivid one. 

The United States had committed Itself to offer- 
ing Samoans an education equal In every way to that 
on the mainland. Tel the Samoan schools w e r c In 



one-room, open file huts, where two classes com- 
peted with each other, fortissimo. The Instruction 
Itself was the most traditional rote learning. I have 
been in these village schools and have heard the kind 
of choral chanting that one becomes accustomed to 
in primitive schools throughout the world. The stu- 
dents repeat back - chant back - what the teacher 
gives them; indeed, this is the only kind of teaching 
possible when the teacher Is untrained, little edu- 
cated, and not at all confident of hls grasp of the sub- 
ject matter. He doesn't dare encourage questions 
or let the students wander away on their own Intel- 
lectual excursions. The teacher says, 1 ‘Class, what 
am 1 doing?" 

Like one, the class chants back, "You - are- 
sianding - on - the - mat. ” 

"Class, what do 1 hare in my hind?" the teacher 
questions. 

"You - have - % - piece - of - chalk," the class 
replies. 

Once t rose, smiled as disarmingly as possible 
at the teacher, and said "Class what am t doing?’ 

"You - are - standing - on - the - mat/’ they re- 
sponded promptly, although t was far away from the 
mat. 

t picked up a book. This puttied them; they could 
see It wasn't chalk. <r What do 1 have In my hand? 1 

One boy ventured: "You - hare - a - piece - of- 
chalt " 

They were quite unable to generalise much upon 
the responses they had learned in their educational 
catechism. 

The results of this kind of thing were predictable. 
The schools were supposed to be the equals of main- 
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land schools, but children g radu a ted Irom the 
twelfth grade testing on the average from fifth to 
ninth grade In different subjects. The teaching was 
supposed to be in English, but little of it w a s, and 
many of the teachers could not speak the language 
underSLandably. The content was derivative fj om 
mainland texts, and so the children learned their 
reading vocabularies from accounts of commuter 
trains, milkmen, and snowball! Ights. I saw one 
elementary- school class being drilled to remember 
that "The 4 Mena Lisa’ is in Milan, "although the sig- 
nificance of that knowledge to a Samoan child was 
not immediately obvious. And over everything hung 
the pall of traditional rote Instruction. 

Now, how do you Iransform a traditional school 
system like that, In a few years, Into a modern 
problem-solving, Inquiring school system? How do 
you live up to the promise and plan to teach in Eng- 
Hsn, with so few English models? That Is the prob- 
lem Governor Lee faced. I am begging the q jest ion 
of whether the level should have been raised in a 
few years, rather than a century; whether it was im- 
portant to have English well taught and well used; 
whether an excellent 12-grade school system was 
what Samoa most needed. But given »hat policy goal, 
how would you proceed? 

What were Governor Lee’s a tt e mat Ives? He 
could replace all three hundred Samoan teachers 
by qualified teachers from the mMnlmd. if he could 
recruit them. But this would ha; e been a politically, 
psychologically, and ethically Impossible solution. 
He could bring in perhaps one hundred teachers 
from the mainland. This would displace less than 
one-third of the native teachers and stir up less 
trouble, but would run head on against on e of t he 
oldest Samoan norms - that allgoforward together. 
He couW Institute a greatly increased teacher pro- 
gram. But this would require sending prospective 
Samoan teachers to the mainland for some years - 
lest they merely perpetuate the quality of the o Id 
school system - and Its effect would not be feh for 
perhaps IS years. Or he could use tele vis Ion to 
share a small amount of expert teaching over many 
classrooms. And this is what he deckled to do. 

But television Itself was not enough. The people 
who studied the problem saw very soon that whst 
they had to create was really a new teaching- learn- 
ing system. They had first to con sol Id ate t he 
schools and provide adequate learning conditions. 
Then they had to create a sort of teaching team, in 
which an expert teacher would give the core of the 
curriculum by television and a native classroom 
teacher would be taught to build a context of learn- 
ing activities aiound the broadcast; and still another 
teacher would prepare study materials and exer- 
cises to fit Into the plan. Make a mental note of 
this, because the same conclusion Is being reached 
all over the worM - that whereas p« ptls learn a 
great deal from television alone, they learn a great 
deal more when it ts built into such ateachtng- 
learning system as * have described. Nowhere In 
the world Is television being used entirely a lore 
and effectively for any major Instructional task. Al- 
ways It Is Integrated Into some kind of system In 
which the studio teacher, the classroom teacher, 
and sometimes others cooperate In stimulating the 
maximum amount of learnlrg activity In the students. 



Governor Lee persuaded Congress that our neg- 
lect of Samoan education should be repaired. A re- 
markable installation was built at Pago Pago, one of 
{he finest Instructional television Installations in the 
world, with six open-circuit channels, ter videotape 
recorders, transmitters on a mountain top, and tel- 
evision teachers, engineers, and producers re- 
cruited from the States. Classes began to move in- 
to the new school buildings In 1964, and television 
began to carry the burden of leaching beginning 
In the autumn of that year. 

How is It working? What evidence Is there that 
television can raise a primitive to a modern system - 
Beeby’s (1966) Class I and II schools to h 1 s Class 
111 and IV schools - in a short time? 

The evidence Isn't alt In, yet, but the signs are 
encouraging. The Samoan elementary schools are 
working very welt, Indeed. The children are speak- 
ing much more and much better English. The tele- 
vision classes are live and active; the pupils talk to 
the teacher and answer her questions Just as though 
she were In the room. There Is much le s s rote 
practice. Children are asking q u e st Lo n s. Some 
schools are making barometers and undertaking 
other special projects. 1 saw one slxlh-gra .e teach- 
er bring in a llrard for Ine class to study. They 
talk d about the little beast, what he a t e , w 1 o ate 
him, and * orked around to the balance of nature. 
This could not possibly have happened cnl) a few 
years ago. I can't say that the high schools - which 
are using, mistakenly or not, very Urge classes - 
are working as well as the elementary. But on the 
whole, It is a very encouraging and hopeful experi- 
ment, one that Is w-orth watching. 

Pause briefly, before we review the next case, 
lo reflect on what seem to be the basic elements of 
the Samoan case: a problem, large, urgent, Im- 
portant enough so that many groups can rally to 
solve It; adequate support, administrative and fi- 
nancial; and the introduction of television, not as a 
separate clement, but as a part of a teaching- learn- 
ing system Integrating all the teachers and a 1 1 the 
classroom activity. 

(Alt h HAtftSTOWN 

Let us turn now from the fale huts and pal m 
groves of Samoa to the green llelds and active in- 
dustries of Maryland. The United States experi- 
ment most often linked to Samoa Is Wage r s t own. 
Most of you are familiar with this system, ai d I 
shall not enumerate what you more than likely a 1- 
ready know about It. 

As you probably know, there were three chief 
reasons for Introducing television into the Washing- 
ton County school system, centering on Hagerstown. 
One was that school officials were anxious to make 
expert teaching of art, musk, and science available 
throughout the elementary schools, and to offer cer- 
tain advanced courses, such as college-level math- 
ematics In high school. To do this with resident 
teachers would have added a great dealto the budget, 
and would have presented severe recruitlrg prob- 
lems. Therefore, they wondered whether U was 
not possible to share expert t etc hlng in these 
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subjects by means o£ television, at a lower cost,or 
al least no higher cost, than by hiring the necessary 
spec lallred teachers. In the second place, they 
wondered whether In the coming years of expanding 
enrollments there would not be some advantage In 
designing schools, not with many rooms about the 
same size, but rather with a central large room or 
rooms lor viewing televised classes, and a number 
of small rooms around the perimeter of the building. 
And, finally, financial help was available - $lmll- 
ion from the Ford Foundation and over $300,000 In 
equipment from manufacturers. 

This was In 1950. Hagerstown decided, as did 
Samoa later, that It needed the equ lva lent of six 
channels to leach the core of an entire curriculum. 
Because open-circuit channels were not available In 
that number al any one point lr the United States, It 
was decided to go closed-circuit. Coaxial cables 
were leased from the telephone company, and ex- 
tended gradually over the next few years to every 
school in Washington County. For more than a half 
dozen years, now, every student In the system has 
revived the core of Ms curriculum from television. 

In Hagerstown, as in Samoa, a studio teacher 
and a classroom teacher operate as a team to teach 
content previously decided upon. The studio teach- 
ers are chosen from the regular teaching corps of 
Hagerstown, and are changed frequently. Because 
all the teachers In the system are qualified andtell 
trained, there has been less difficulty, IntheHagers- 
town than in the Samoa experiment, In getting the 
classroom teacher to play his new role expertly. 
But two elements are generally credited with the 
smooth transition In Hagerstown fromthe older plan 
to the television teaching team. One of these is the 
firm support given the pr o j e c t by Superintendent 
William Brlsh. In a sense he played t he role In 
Hagerstown that Governor Lee played In Samoa. The 
second is the Insistence throughout on Involving as 
many teachers as possible and thus reducing the 
potential threat of the new method. Only about S 
percent of all the Hagerstown television teaching is 
taped, and very little of It Is brought In from outside. 
Thus teaching on television Is treated as an ordinary 
function of team teaching, not specialty rewarded, 
and passed around among promising candidates. 

A considerable amount of re sc arch ha sheen done 
at Hagerstown, and some of the results of Introduc- 
ing television have been spectacular. Remember, 
now, that this is not a deprived school system, nor 
was It In I9W. It Is a rather average American 
system. But in Hagerstown junior high schools dur- 
ing the first four years of television the average 
performance of students on a standardized t e a t of 
arithmetical concepts rose from the thirty-first to 
the eighty-fourth percentile, measured against na- 
tional norms, and on a standardized test of problem 
solving It rose from the thirty-third to the a Ixty- 
elghth percentile. Inother words, before television, 
two-thirds of the junior- high- school pu pk l s of the 
country scored above Hagerstown children on these 
arithmetic tests; after television, two -thirds scored 
below Hagerstown. In the f I ft h grade, during the 
first year of television teaching, the average Hagers- 
town pwptl gained 1. 9 years, rather than the one 
year represented by national norms. In the year 
before television was Introduced, every ooe cf the 



grades three through six averaged below national 
norms In arllhmexlc. Within 2 years, each grade 
averaged above the national nor ms. V> e have spoken 
only of arilhmeilc. Not all results were as good as 
these, but the gains were by no means 1 1 m l ted to 
arithmetic. Perhaps the most significant verdict 
was turned in by the school board of W a sh Ing to n 
County who, In 1960 when the Ford grantcame to an 
end, studied the results, gave all teachers and ad- 
ministrators a chance to express their opln Ions 
anonymously, and then voted w 1 1 h o u t a dissenting 
voice to take over the approximately $600,000 annu- 
al cost of the television In their own todget. 

USE 3: NKt* 

Both Hagerstown and Samoa, one might say, prof- 
ited by American know-how In television. Suppose 
now we t'.rn to a country that has had little or do 
help from the United States In television. Niger has 
only sixty-six fully qualified teachers - meaning 
teachers who are secondary school graduates and 
have had teacher training. There are some hundreds 
more who have had the equivalent ofjunior high 
schc^t education, and still more who have had only 
5 or C years In school. But there Is silll no hope 
for adding to the resource In highly educated and 
trained teachers until the country's higher priority 
needs for educated people have been met. This cre- 
ates an extremely difficult situation because Niger, 
which has had only between 5 and 10 percent of Us 
school-age children in the classroom, Is now trying 
to double and soon to triple Its school population, 
and especially to stre:>gthen Its secondary schools. 
The problem was, then, how to find the necessary 
number of skilled teachers. 

Acting with the advke and help of the French 
fovernment, Niger developed a plan for using expert 
teachers In the studio and monitors In the classroom. 
Unlike Samoa and Hagerstown, which began with all 
the elementary and secondary grades at the same 
time, Niger began with the first grade. It began 
very cautiously, In fact, with only two schools, and 
with closed- circuit television. By the tlmetbecoun- 
try’s new open-circuit television station went on the 
air, the first-grade experiment had shaken down, 
and the television was expended to the second grade. 
The plan is to add one grade a year. 

Like Samoa and Hagerstown, Niger has found It 
works best to create In effect a teaching team in the 
studio and the classroom, and like Samoa It has 
found that the weakest link in the team Is the class- 
room teacher when that Individual Is not adequately 
trained. Using element ary* school- trained monitors 
In the classroom, the supervisors of the Niger pro- 
ject have tried short in-service training cou r aes, 
and have decided more intensive special training 
Is needed. One of the ways Samoa tried to s olve 
the problem of helping the relatively untrained class- 
room teacher to learn his new role was by fitting in- 
to every school an American principal, who worked 
with his teachers and served really as a supervisor. 
They also brought all the teachers toasU-week 
summer workshop each year, and conducted da I ly 
In- service training by television. No easy way has 
been found anywhere to solve this pari >ular problem, 
but it has reappeared again and again in developing 
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countries where Instructional television has been 
Introduced. 

One o f the distinctive features of the Niger exper- 
Iment ha'* been the continuing presence of a three- 
man research team supplied by France - a psychol- 
ogist, a sociologist, and an ethnologist. These peo- 
ple are studying very closely the effect of television 
teaching on African children who have never before 
seer television, and, most of them, have never be- 
fore spoken French, which Is the language of Instruc- 
tion. Their psychological and cultural reports are 
not yet available, but they have measured the learn- 
ing results of the first year. As might be expected, 
the results were better In some subjects than others, 
and somewhat better for children who were a year 
older than the others. But as a whole, the televi- 
sion classes averaged well above the average per- 
formance of non-television classes. We must s ay 
of Niger, as of Samoa, that all the evidence has not 
come In, but the outlook is highly encouraging. 

SOME NOUS ON OTHER CASES 

We will deal with several additional cases In a 
more brief manner. 

You have noticed that In all three of the cases 1 
have mentioned, generous financial help was avail- 
able, and In the case of the twodeveloplr.gcountrie * 
expert counsel was also freely offered. What would 
happen now If a developing country tried to go it oi 
iti own? 

It isn't a recommended procedure, butlthasbeen 
done. It was done, for example, tn Arequlpa, Peru. 
In that high Andean city, a group of school teachers, 
members of a religious discussion group, decided to 
undertake a community project. Looking around 
them, they saw that hundreds of children were un- 
able to gain entrance Into the schools because of 
shortage of places for them. Hundreds of others 
had left school after 3 or 4 years. They decided to 
b<yln with a group of the school-1 e avers who had 
gone to work as domestic servants. Suppose that 
the employers of these children would tel them watch 
television an hour a day, they said. And suppose 
that the proprietor of a s mill local television station 
would give some free air time. And suppose that 
we were to do the teaching, and could get help In 
preparing learning materials. Well, all these things 
can.e true. Although with some objection, the em- 
ployers let their domestic servants watch television; 
the station offered up to three hours free time; the 
leathers donated their time; the priest who was head 
of the discussion group supervised the curriculum, 
And a television school tor school-leavers went on 
the air without a single pild emp>oyee. Since that 
tlnv?, the project has Immensely expanded, now has 
a government contract and some pa id employees, 
and offers a varied grouped Out- of- school courses, 
adult courses, and so forth, it ha a been almost 
fierce^ local, resisting rather than Inviting outside 
advice and help, and this has not been wholly to Rs 
advantage. But at least the Arequlpa story shows 
that the do-it-yourself spirit Unot entirety missing 
from Instructional television tn the new countries. 

We have reviewed several uses of Instructional 
tele vis too in school. The Ar equips project was 



mostly for out-of-school use. There ha /e been a 
number of other projects of that kind, aimed at ex- 
tending educational opportunities beyond the school - 
for instance, Telescuola which provides secondary 
education for Kalian children who do net have sec- 
ondary schools in their areas; and the Ci.lcago Jun- 
ior College which for nearly 10 years now has of- 
fered a complete Junior college curriculum by tele- 
vision, with the home television students doing con- 
sistently better than classroom sludenlson the same 
examinations. Television has been u sed to help 
teach literacy - In places like t..e Ivory Coast where 
It has helped to train native workers to read, write, 
and speak French, and do simple arithmetic so that 
they could be made middle-level supervisors; a nd 
In Italy where about 15,000 adults annually register 
to study reading, writing, and arithmetic, with the 
aid of the famous program series, “Never Too 
Late. ** The trend of the evidence tn literacy exper- 
iments, though, is that, whereas television can as- 
sist greatly by providing visual material, by moti- 
vating a group, and bringing a certain amount of ex- 
pertness, the real key io what happens lies tn the 
ability of the group supervisor, A straw In the wind 
is that Italy, which at first used only monitors in 
Us viewing groups, now usescertlllcated teachers - 
usually working outside school hours - for that pur- 
pose. 



One more note: from almost everywhere Instruc- 
tional television has been used comes word that it 
is an excellent vehicle for In-service teacher train- 
ing. The mere example of excellent teaching tele- 
vised into a teacher's own subject is itself effective. 
As some observers In Samoa remarked, this may 
have been the first time that some of the native 
teachers had ever seen a welt-made lesson in their 
own grade level and field. Furthermore, to prepare 
the teachers for teaching an unfamiliar subj ect o * 
method, like the new math, television has proved 
an excellent in-service training tool. It was used 
for that purpose In Colombia, for example, and the 
results were carefully measured. The amount of 
learning was very high, but with teachers as with 
pupils the total amount depends greatly on what hap- 
pens on the receiving end. That is to say, whereas 
a considerable amount was learned from television 
alone, a great deal mere was learned if the teachers 
met In groups and discussed the broadcast lesson, 
and still more If the groups had competent snpe r- 
visors to direct the discussion. 



We have said enough now to Indicate that instruc- 
tional televison, used well, can contribute toward 
the solution of a great variety of educational prob- 
lems - the need to raise Instructional level quickly 
without a teaching corps adequate for the purpose, 
making up for the scarcity of speciillted or highly 
trained teachers, extending the school beyond its 
physical boundaries, helping to teach adult literacy, 
and providing In-service tralnlrgfor teachers. This 
Is rtof, by any means, to say that it always works 
well, t could cite some very disappointing stones 
to balance the encouraging ones I have mentioned. 
But t believe we know enough now to advance a set 
of propositions as to what are the conditions under 
which It Is likely to work effectively. Let me sug- 
gest some of these. 
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